-- Logs begin at Wed 2022-10-05 13:31:35 UTC, end at Wed 2022-10-05 14:27:48 UTC. -- Oct 05 13:56:43.744828 dv-cinder-835878-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 05 13:56:43.752099 dv-cinder-835878-4-smb devstack@keystone.service[81604]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 13:56:43 2022] *** Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: nodename: dv-cinder-835878-4-smb Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: machine: x86_64 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: clock source: unix Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: pcre jit disabled Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: detected number of CPU cores: 4 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: current working directory: / Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: detected binary path: /usr/bin/uwsgi-core Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: your processes number limit is 47680 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: your memory page size is 4096 bytes Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: detected max file descriptor number: 2048 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: lock engine: pthread robust mutexes Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: thunder lock: enabled Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 05 13:56:43.757425 dv-cinder-835878-4-smb devstack@keystone.service[81604]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 13:56:43.795669 dv-cinder-835878-4-smb devstack@keystone.service[81604]: Python main interpreter initialized at 0x55ac47bc09c0 Oct 05 13:56:43.795669 dv-cinder-835878-4-smb devstack@keystone.service[81604]: python threads support enabled Oct 05 13:56:43.795857 dv-cinder-835878-4-smb devstack@keystone.service[81604]: your server socket listen backlog is limited to 100 connections Oct 05 13:56:43.795857 dv-cinder-835878-4-smb devstack@keystone.service[81604]: your mercy for graceful operations on workers is 90 seconds Oct 05 13:56:43.796035 dv-cinder-835878-4-smb devstack@keystone.service[81604]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 13:56:43.796115 dv-cinder-835878-4-smb devstack@keystone.service[81604]: *** Operational MODE: preforking *** Oct 05 13:56:43.796380 dv-cinder-835878-4-smb devstack@keystone.service[81604]: *** uWSGI is running in multiple interpreter mode *** Oct 05 13:56:43.796380 dv-cinder-835878-4-smb devstack@keystone.service[81604]: spawned uWSGI master process (pid: 81604) Oct 05 13:56:43.796580 dv-cinder-835878-4-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 05 13:56:43.797178 dv-cinder-835878-4-smb devstack@keystone.service[81604]: spawned uWSGI worker 1 (pid: 81612, cores: 1) Oct 05 13:56:43.797566 dv-cinder-835878-4-smb devstack@keystone.service[81604]: spawned uWSGI worker 2 (pid: 81613, cores: 1) Oct 05 13:56:43.797733 dv-cinder-835878-4-smb devstack@keystone.service[81604]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 13:56:48.059267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 13:56:48.059267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Oct 05 13:56:48.060026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 13:56:48.060026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: from cryptography.utils import int_from_bytes Oct 05 13:56:48.060291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 13:56:48.060291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Oct 05 13:56:48.060753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 13:56:48.060753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: from cryptography.utils import int_from_bytes Oct 05 13:56:48.110840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 13:56:48.111031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 13:56:48.111125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 13:56:48.111215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 13:56:48.111296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] command line args: [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 13:56:48.111375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] command line args: [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 13:56:48.111452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 13:56:48.111534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 13:56:48.111608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ================================================================================ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 13:56:48.111684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ================================================================================ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 13:56:48.111857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.111946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.112101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_dir = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.112189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_dir = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.112639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] config_source = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] config_source = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] debug = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] debug = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.113927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.114905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_config_append = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_config_append = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_dir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_dir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.115933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.116899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.117945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.118934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] publish_errors = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] publish_errors = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.119892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.120917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] standard_threads = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] standard_threads = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_journal = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_journal = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.121957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_json = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_json = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_stderr = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_stderr = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] use_syslog = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] use_syslog = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 13:56:48.122680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.122764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.122916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.123966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.124931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.125934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126809 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.126888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.127852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.128864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.129982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.130923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.131942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.132997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.133951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.134964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.135892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.136946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.137978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.138937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.139913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.140988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.141965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.142980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.143978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.144903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.145998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.146944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.147925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.external = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.external = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.148986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.password = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.password = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] auth.token = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] auth.token = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.149941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.150900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.151858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.152968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.153803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.154997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.155945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.156988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.157969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.158917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.159064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.159634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.159826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.159905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.160864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.161980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.162984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.163999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.164923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.165901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.166995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.167921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.168989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169312 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.169967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.170979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171220 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.171951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.172896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.173849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.174890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.175549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.175629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.175785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.175865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.176977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.177055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.177232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.177313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.177494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.177823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.178835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.179005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.179074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.179246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.179323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.181908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.182979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.183929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.184949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185112 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.185957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.186876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.187843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.188982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.189946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.190992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.191928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.192872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.193854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.194962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.195937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.196984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.197947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.198886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.199990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.200070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.200143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 13:56:48.200478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.200478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.200687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.200919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 13:56:48.201087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 13:56:48.230131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.230276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.230377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.230516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.230601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.230749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.239633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.239893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.267117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.267342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.267560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.267798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.320240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.320658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.368872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.369101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.369999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.370671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.523301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.523522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.523744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.523830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.523962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.524854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.547981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.548831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.559575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.559968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.572963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.573687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81612) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 13:56:48.590349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.590558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 13:56:48.590901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.591093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.591178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 13:56:48.591308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 13:56:48.591407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.591615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.591697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.591842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 13:56:48.591924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.592120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.592203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.592385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.592649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.592913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.602199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.602481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.602755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.603036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.603119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.603339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.603620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.603914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.610014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.610918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.613588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.614016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.614195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.614437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.614521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.614771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.614853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.615966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.616971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.639128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.639719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.640585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.640873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.641195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.641511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.646038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.646326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.646610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.646728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.647019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.647310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.652864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.653163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.653670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.653966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.658739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.659036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.659913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.660179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.660263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.660463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.660554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.660737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.660819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.661873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.662152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.676645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.676933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.677680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.677974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.680771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.681865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.684015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.684311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.685104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.685436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.688491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.689660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.691729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.692866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.694959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.695261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.695548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.695833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.696997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.697305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.697595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.712610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.712898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.713166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.713455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.713870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.714168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.714445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.714713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.720235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.721601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.722328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.723701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.723858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.724135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.725270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.725554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.726882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.727169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.727461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.727744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.728140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.728321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.728614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.728912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.729203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.729635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.739423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.739713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.739996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.740296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.740681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.740970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.741063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.741268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.741363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.741639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.741938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.742330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.742627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.742916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.756522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.758318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.759428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.761259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.762307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.763905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.764131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.765454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.765711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.765800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.766131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.767193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.767485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.767900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.772987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.774477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.774837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.776322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.777359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.777757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.778046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.778326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.779230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.779637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.779929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.780215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.786645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.786936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.787216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.788587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.788887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.789175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.794065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.794356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.794639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.794927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.795204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.795490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.795765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81612) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 13:56:48.796310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.796969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.797807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.798005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.798294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.798569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.798855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.799141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.799445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.799765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81612) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 13:56:48.831798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac47bc09c0 pid: 81613 (default app) Oct 05 13:56:48.834199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ac47bc09c0 pid: 81612 (default app) Oct 05 13:56:48.835019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6d3e-b92d-44b3-bc98-b916b672f907 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:48.835305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6d3e-b92d-44b3-bc98-b916b672f907 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:48.835582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6d3e-b92d-44b3-bc98-b916b672f907 None None] PATH_INFO: `/v3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:48.839728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Oct 5 13:56:48 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:56:55.625041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:55.625583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:55.625689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:55.629877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:56:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:56:55.635105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:55.635691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:55.635691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:55.705549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: INFO dbcounter [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] Registered counter for database keystone Oct 05 13:56:55.724779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG oslo_db.sqlalchemy.engines [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 13:56:55.731134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writer thread running {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 13:56:55.907633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81613) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 05 13:56:55.907970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG passlib.handlers.bcrypt [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81613) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 05 13:56:55.966524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:56:55.968098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:56:56.092404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:56:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 05 13:56:56.549500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:56:56.619023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: INFO dbcounter [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] Registered counter for database keystone Oct 05 13:56:56.640518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG oslo_db.sqlalchemy.engines [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 13:56:56.647269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writer thread running {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 13:56:56.764508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328711f1-70b5-4a42-801f-e3f0f8e6cd14 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:56:56.769288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:56:56.769919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:56.770200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:56.770472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:56.778675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:56:56.833861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 05 13:56:56.834150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d07e-889f-4b40-b623-2c132e3255c0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:56:56.843548 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 5 13:56:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 13:56:56.850032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:56:56.866967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3b4b-d77d-434d-b790-b9613b717771 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:56:56.871385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:56:56.872483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:56.872765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:56.873043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] PATH_INFO: `/v3/projects/385992f3807a48ff8e105d88b2b7542e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:56.874676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] RBAC: Authorizing `identity:get_project(project_id=385992f3807a48ff8e105d88b2b7542e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:56:56.927266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 05 13:56:56.927620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b90eb-4594-463f-b035-cf6a76c2eafc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:56:56.932171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 5 13:56:56 2022] GET /identity/v3/projects/385992f3807a48ff8e105d88b2b7542e => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:56:59.038263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894f70-3438-4a3f-be26-fc093c3a349d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:59.038764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894f70-3438-4a3f-be26-fc093c3a349d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:59.038764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894f70-3438-4a3f-be26-fc093c3a349d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:59.042813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:56:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:56:59.048185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:59.048561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:59.048737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:59.068472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:56:59.070006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:56:59.078835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:56:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 05 13:56:59.343855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894f70-3438-4a3f-be26-fc093c3a349d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:56:59.356425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894f70-3438-4a3f-be26-fc093c3a349d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:56:59.360632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:56:59.361243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:59.361532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:59.361808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:59.369568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:56:59.371341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a151b4d-9d27-48af-8f38-32ee20e0a126 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:56:59.380377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 5 13:56:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 13:56:59.385541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:56:59.395032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ca21a-f4cc-41d1-bdbd-0c31b7a94400 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:56:59.399334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:56:59.399951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:56:59.400231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:56:59.400506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:56:59.401842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:56:59.403666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd16b-6a57-491b-8df0-6a4c1f4721e2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:56:59.405177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Oct 5 13:56:59 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:01.589103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3856-9a55-40bb-8703-0e1ec35d6c88 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:01.589670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3856-9a55-40bb-8703-0e1ec35d6c88 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:01.589670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3856-9a55-40bb-8703-0e1ec35d6c88 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:01.591039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:01.596099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:01.596496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:01.596770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:01.620806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:01.622028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:01.640773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbab1f-31ab-4399-ba63-e803bd1d7fc4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:01.641060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbab1f-31ab-4399-ba63-e803bd1d7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:01.641370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbab1f-31ab-4399-ba63-e803bd1d7fc4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:01.642685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:01.647788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:01.648071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:01.648339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:01.689986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81612) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 05 13:57:01.690382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG passlib.handlers.bcrypt [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81612) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 05 13:57:01.702076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:01.739870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:01.741464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:01.839941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:01.971827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:01.997129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.076343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c2937-3d7c-4867-85c2-975e01b584c4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.102638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.109649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.110782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.111076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.111359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.123825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:02.133316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:02.134194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:02.134985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:02.140094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.201981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff2710-e033-4534-ab89-3e9b2bfa10fa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.204298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.219497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.238523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa61509-e943-49cb-b2b7-bead90b8bc5c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.240234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.241180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.241494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.241766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.272222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.272824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.273102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.273399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.274068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:02.274370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.275756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.287222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:02.293113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.308490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.310056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.390005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a715350-fa4c-4016-8f95-9a73ae71205b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.405549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:57:02.411568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.414177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.423186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.423820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.424102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.424379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.426147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.427604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.429162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:02.434424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.448446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.509927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d7830-96ab-4b8d-a404-b3c160970e6a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.531183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d831f1-e4b8-4767-b8d6-60cfcb907c83 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.542278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.543124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.543403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.543674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.562080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.563526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.564851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.565520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.566043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.566160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.567220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.568710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.570520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:02.575973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:57:02.581127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:02.582194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:57:02.583196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:57:02.583196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:57:02.583196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:02.583196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:02.587804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:02.642650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.665402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:02.685605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eeca3-5954-4a57-a510-aab0c5fefe4d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.688367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aebf95-c093-4ce6-8a4c-4381798d4fac None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:02.718580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.719189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.719469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.719744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.720467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.domain.id=default, user.id=1ee0b2255cbf41fe9a777949eff22087) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:02.720774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.720987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:02.721628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:02.721917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:02.722811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:02.722910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bdb40-c22c-4861-9279-9d75cca54e57 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.723458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:02.723766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:02.725344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea1a32-0ee6-406b-883e-ae343a2a371b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:02.729484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/role_assignments?user.id=1ee0b2255cbf41fe9a777949eff22087&scope.domain.id=default&role.id=7cd2a85ba9004397b74226de1219a45f => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:02.744556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:05.075565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb067cf-f869-4f01-9469-f080e9ee28a1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.076503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb067cf-f869-4f01-9469-f080e9ee28a1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.076991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb067cf-f869-4f01-9469-f080e9ee28a1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.078582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:05.094960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5cd3e-57d7-4f45-a985-07b971f9536a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.095430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5cd3e-57d7-4f45-a985-07b971f9536a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.095599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5cd3e-57d7-4f45-a985-07b971f9536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.122688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-02a5cd3e-57d7-4f45-a985-07b971f9536a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:05.123910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-02a5cd3e-57d7-4f45-a985-07b971f9536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:05.214601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:05.535411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57459-8ada-4468-9f90-1be9b6cd9c0d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.536086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57459-8ada-4468-9f90-1be9b6cd9c0d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.536586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57459-8ada-4468-9f90-1be9b6cd9c0d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.538564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:05.544253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.544885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.545422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.570280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:05.571840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:05.621799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:05.653439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:05.708900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec37a9-b3e8-4c7e-8efd-9714a4e6861a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.709218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec37a9-b3e8-4c7e-8efd-9714a4e6861a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.709497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec37a9-b3e8-4c7e-8efd-9714a4e6861a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.711056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:05.716355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475ad3-5075-4bbd-b1e8-48ac55580bf9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.716647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475ad3-5075-4bbd-b1e8-48ac55580bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.716933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4475ad3-5075-4bbd-b1e8-48ac55580bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.720358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:05.746755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e4475ad3-5075-4bbd-b1e8-48ac55580bf9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:05.749396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4475ad3-5075-4bbd-b1e8-48ac55580bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:05.898813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:05.899788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a8b-1b3f-453a-a5aa-a98c54ca509a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.900076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a8b-1b3f-453a-a5aa-a98c54ca509a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.900350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a8b-1b3f-453a-a5aa-a98c54ca509a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.901772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 16/28] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:05.909432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:05.909752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:05.910028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:05.946303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:05.947495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:05.963433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda71b5-750d-448b-a48d-6862cf0e8828 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.016206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:06.016856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:06.017401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:06.017704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:06.031583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:06.035777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 17/29] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:06.037046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:06.038221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:06.039285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:06.040222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:06.043000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:06.044490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 13/30] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:06.054819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.122118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:06.228991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9afb8-f5fb-47b6-aa0f-1ea7c9f6e3a3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.246989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246b7c-a8fb-485e-b743-871b411ae643 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.286594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:06.288030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:06.288256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:06.288530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:06.289206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:06.290630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:06.307473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:06.308089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:06.308374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:06.308649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:06.309350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:06.309694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:06.311094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:06.346174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 14/31] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:06.347540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.450296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 18/32] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 13:57:06 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:06.455070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.567783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d0c9-99e3-4e46-b5d5-f5aacd9e2c2f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.576414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:06.592018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:06.607772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:06.608845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:06.609355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:06.609865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:06.610807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:06.612528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:06.692102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835ee95-c491-4d82-be99-5129cbeda484 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.740948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:06.742080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:06.742593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:06.743064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:06.744524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:06.746431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:06.748365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 19/33] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:06 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:06.750677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.767036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 15/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 13:57:06 2022] POST /identity/v3/roles => generated 225 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:06.767036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:06.951072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5aca5-5489-46cc-bac3-a55ab9c77657 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:06.999472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f22e-c5ca-46f0-8615-d238f2fdc8f5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.005992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:07.012903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.013558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.013844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.014842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.029296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.030874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.045586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.046054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.046412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.046761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.048411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.050065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e48381-5f3a-4e5d-9ecb-7fe9dafd2887 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.052102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 16/35] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:57:07.052867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:07.053772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:57:07.054613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:57:07.054613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:57:07.054613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:07.054765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350aa2a-6f75-4545-a6de-da2600177066 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.054765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350aa2a-6f75-4545-a6de-da2600177066 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.054765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350aa2a-6f75-4545-a6de-da2600177066 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.055629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 17/36] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:07.055735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 20/37] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:07.062417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:07.062565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350aa2a-6f75-4545-a6de-da2600177066 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:07.093765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:07.179570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350aa2a-6f75-4545-a6de-da2600177066 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.184889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d90e-9cb1-4cd1-970e-75c0c73ac9f1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.216260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.216827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.217115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.217449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.218133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:07.218440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.219895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343035-9d05-4cd9-8e7b-663522350b3d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.237394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:07.239555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0148e-b7b1-4201-b142-6036e61b011f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.239852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0148e-b7b1-4201-b142-6036e61b011f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.240130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0148e-b7b1-4201-b142-6036e61b011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.260126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3cc0148e-b7b1-4201-b142-6036e61b011f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:07.261767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3cc0148e-b7b1-4201-b142-6036e61b011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:07.329827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.330540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.330772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.331040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:07.331135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] PATH_INFO: `/v3/domains/default/users/1ee0b2255cbf41fe9a777949eff22087/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.332298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63b87-d2b5-4cde-92e5-0cf2416d3b02 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.332597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63b87-d2b5-4cde-92e5-0cf2416d3b02 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.332930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63b87-d2b5-4cde-92e5-0cf2416d3b02 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.333428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ee0b2255cbf41fe9a777949eff22087, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.334371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:07.334952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8903e-ffca-4273-a761-087d07aa24cd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.338937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf63b87-d2b5-4cde-92e5-0cf2416d3b02 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:07.357536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Oct 5 13:57:07 2022] PUT /identity/v3/domains/default/users/1ee0b2255cbf41fe9a777949eff22087/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:07.358726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:07.368118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.368460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.368688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.397911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:07.401013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:07.472154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:07.478020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf63b87-d2b5-4cde-92e5-0cf2416d3b02 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.515235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:07.527153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.528140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.528634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.529121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.530036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.531708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.566917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 21/43] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:57:07 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:07.603877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:07.717909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7cb48-0ab4-4b2b-855b-d70f3ec125d3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.755679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.756303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.756588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.756864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.757580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.758957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.775944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 13:57:07 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:07.812079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:07.892540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:07.933633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb164-793a-46f9-b5ca-b8e4946d929c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:07.972035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:07.973411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:07.973649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:07.973928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:07.975050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:07.976530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aec49-79f3-46a0-9023-1cb09e9afa32 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:07.978237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:07.984120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:08.024165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:08.088610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba386b-4f0c-4e34-956f-be859a842284 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:08.121790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:08.122401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:08.122681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:08.122957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:08.123616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:08.125083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3921a-ea8a-4702-92ee-1e82413b7154 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:08.152572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:57:07 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:09.614651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790810a-ad60-4593-8c50-9628b2e4d212 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:09.615167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790810a-ad60-4593-8c50-9628b2e4d212 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:09.615273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790810a-ad60-4593-8c50-9628b2e4d212 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:09.616553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:09.621894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:09.622306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:09.622451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:09.640205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:09.641408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:09.705787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:09.970672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790810a-ad60-4593-8c50-9628b2e4d212 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.070169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790810a-ad60-4593-8c50-9628b2e4d212 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.102202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.102825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.103106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.103381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.105965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.115467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:10.120294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:10.121138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:10.121907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:10.127212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.143991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.229089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f841c0-16f1-43fe-9985-2fec7b3f8670 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.262149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.262768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.263055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.263396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.264101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:10.264412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.265854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04406a-739b-4eff-8010-9000ae12a5b6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.274540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:10.280137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.301885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d8b1-8b61-423d-bc64-4e188ce9e394 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.302605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d8b1-8b61-423d-bc64-4e188ce9e394 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.302894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d8b1-8b61-423d-bc64-4e188ce9e394 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.304228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 27/51] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:10.309177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.309499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.309783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.327223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:10.328438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:10.378538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faf64c-3191-49a3-ae0d-65f93f695475 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.395015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 28/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:10.412137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.412769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.413053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.413362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.414701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.416156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.417760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 25/53] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:10 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:10.423027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.433888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.521622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5994c0-2348-40db-b72d-8bd267a93dfe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.554551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.555189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.555472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.555747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.556860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.558335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.559893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 29/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:10.565632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.626877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.670068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.751357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.771500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd98807-b7bf-49e4-a1e5-6417ae7ea821 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.774981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9380-52aa-4d63-837c-6283570ec257 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.805239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.805903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.806136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.806412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.807137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.domain.id=default, user.id=1ee0b2255cbf41fe9a777949eff22087) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:10.807448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.808650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.808892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc8b84-974d-4ae2-9196-4ebbef964093 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.809312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.809596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.809870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.810971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.812412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.814424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 30/55] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:10.817960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 5 13:57:10 2022] GET /identity/v3/role_assignments?user.id=1ee0b2255cbf41fe9a777949eff22087&scope.domain.id=default&role.id=7cd2a85ba9004397b74226de1219a45f => generated 530 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:10.819954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:10.927528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb863-6034-4b92-b217-41eba4520a6d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:10.963326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:10.963963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:10.964250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:10.964531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:10.965214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:10.966728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f8149-ef3e-479e-8588-f3f636ab59a7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:10.984063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:10.999058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 5 13:57:10 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:57:13.110922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f84ab-9ace-4f89-a1a3-9f576bbbd46f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:13.111410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f84ab-9ace-4f89-a1a3-9f576bbbd46f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:13.111410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f84ab-9ace-4f89-a1a3-9f576bbbd46f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:13.112773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:13.118372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:13.118786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:13.118969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:13.137905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:13.139093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:13.204269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:13.480756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f84ab-9ace-4f89-a1a3-9f576bbbd46f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:13.586781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f84ab-9ace-4f89-a1a3-9f576bbbd46f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:13.612907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:13.620931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:13.621610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:13.621898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:13.622172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:13.623279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:13.624727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bd702-1a19-4f14-8a1b-fdbdc90ca7e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:13.626331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:13.632598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:13.726260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67797808-da72-4191-b2d1-9281e2097cb2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:13.750867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:13.760000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:13.760600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:13.760883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:13.761159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:13.761836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:13.763283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067e6c-c82b-4101-b179-5dfff5528e60 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:13.789518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:13 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:16.928909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cdad-cb44-413c-9306-80df252d9372 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:16.929930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cdad-cb44-413c-9306-80df252d9372 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:16.930426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cdad-cb44-413c-9306-80df252d9372 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:16.932245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:16.939952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bd29-3492-4ef3-b6e0-38fc86a33c21 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:16.940748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bd29-3492-4ef3-b6e0-38fc86a33c21 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:16.941218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bd29-3492-4ef3-b6e0-38fc86a33c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:16.966252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0654bd29-3492-4ef3-b6e0-38fc86a33c21 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:16.967786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0654bd29-3492-4ef3-b6e0-38fc86a33c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:17.056540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:17.103162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e69-4ed4-4c91-9585-9ae596fd8c0d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.103765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e69-4ed4-4c91-9585-9ae596fd8c0d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.104281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e69-4ed4-4c91-9585-9ae596fd8c0d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.105879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 30/64] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:17.111207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a097e6a-cb78-4f3a-802a-8b09004b76ae None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.111762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a097e6a-cb78-4f3a-802a-8b09004b76ae None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.112228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a097e6a-cb78-4f3a-802a-8b09004b76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.142325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5a097e6a-cb78-4f3a-802a-8b09004b76ae None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:17.143863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5a097e6a-cb78-4f3a-802a-8b09004b76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:17.231614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:17.347424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437e69-4ed4-4c91-9585-9ae596fd8c0d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:17.485443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c171f5-f7aa-40ad-9f4f-9c33451cc7d3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.486132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c171f5-f7aa-40ad-9f4f-9c33451cc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.486626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c171f5-f7aa-40ad-9f4f-9c33451cc7d3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.488162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 36/66] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:17.491827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437e69-4ed4-4c91-9585-9ae596fd8c0d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:17.505278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.505868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.506377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.533759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:17.534956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:17.544259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:17.544895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.545178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.545485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.567549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:17.572620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:17.573584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:17.574349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 31/67] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:17.580536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:17.615738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:17.652227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 37/68] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:17.652900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:17.660450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:17.710329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75498b-df9f-411c-8e80-55a9b142047d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:17.750352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:17.750964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.751258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.751585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.752520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:17.753252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:17.755003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98467c-3836-4d33-85e8-1bb0222e9302 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:17.765262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 32/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:17.766405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749960b-9cfd-49d1-a0f1-c423aab8f4c7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.766698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749960b-9cfd-49d1-a0f1-c423aab8f4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.766980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749960b-9cfd-49d1-a0f1-c423aab8f4c7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.768434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 33/70] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:17.775160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749960b-9cfd-49d1-a0f1-c423aab8f4c7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:17.814439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e32a7a-fe01-4fb8-bba3-a78ca18ff5ec None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:17.866321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:17.867894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.868257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.868609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.882107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-92a588a9-ad25-40b0-8eb6-9d8eac582d83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:17.888555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:17.890614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:17.892030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:17.893093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0737e7-0f95-436b-8f4c-deca06b56a54 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.893093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0737e7-0f95-436b-8f4c-deca06b56a54 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.893299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0737e7-0f95-436b-8f4c-deca06b56a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.907505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749960b-9cfd-49d1-a0f1-c423aab8f4c7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:17.912889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4c0737e7-0f95-436b-8f4c-deca06b56a54 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:17.914120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4c0737e7-0f95-436b-8f4c-deca06b56a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:17.926519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:17.941173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:17.948712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:17.949333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.949620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.950064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.951907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:17.953454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:17.955270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:17.956315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:17.983917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:17.985448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad2231-f96a-42eb-86fd-51b116676b8c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:17.985734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad2231-f96a-42eb-86fd-51b116676b8c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:17.986009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad2231-f96a-42eb-86fd-51b116676b8c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:17.987235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 40/74] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:17.992194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad2231-f96a-42eb-86fd-51b116676b8c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.068528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3e468-73da-41fb-9259-9145d3ec3778 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.104859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.105490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.105772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.106045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.106702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:18.106873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad2231-f96a-42eb-86fd-51b116676b8c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.107037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.108356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.117267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 35/75] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.117848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.148159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.148780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.149063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.149378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.167493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.180279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.222793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3a38a-cb97-4718-b1a5-744b1e395c92 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.224562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.226113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.257839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.258468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.258759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.259043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.268976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-02320ae9-edf0-42e6-8fef-c588a37d975a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:18.274809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:18.275645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:18.276380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 36/76] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:18.281770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.282064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.282344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.299234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:18.300577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:18.328167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 41/77] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:18.329010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.383646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 37/78] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:18.383646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.406393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.414683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.447541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce716ac9-6eb8-4d78-89c7-03d3ecfad97f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.478284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6922b-4518-43b9-91ca-c8b4a88d51e2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.482298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.482932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.483216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.483494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.497589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.499050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.500661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 42/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.502392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.514547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.515184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.515473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.515752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.526522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:18.531399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:18.532241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:18.532983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 38/80] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:18.534410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.611840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d33e3-38bb-48b0-86cd-d214652f3fd0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.633416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.639451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.644207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c3d1-d4d6-48be-9f77-fc2c618b69d8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.647513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.648128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.648409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.648684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.649381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:18.649690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.651104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.659180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.659870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.679471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.680328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.680612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.680886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.682059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.683525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.685143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 39/82] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.685933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.762274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af94c-279a-4b43-aafd-c382636fc2a9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.782503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069de55-0e50-475b-bf2a-ab371b888a7c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.799453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.800064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.800348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.800627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.815905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.816502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.816784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.817643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.818302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:18.818611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.819967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.827807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 40/83] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.828670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.851704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.855246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:18.871414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.872884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.924489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683214c-8dd2-4c5b-b45e-e6c260a4aa6e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:18.957841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:18.958471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:18.958760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:18.959038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:18.960142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:18.961606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:18.963177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:18.965430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:18.972030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 44/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:18.972030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.046823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.057398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.063463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340ae8c-ded8-489d-9e98-6cc0284fc0ee None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.066188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50048b-b680-4756-b454-28e93146d5bb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.096245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.096860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.097144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.097449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.099099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.099949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.100552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.100639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.100830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.101105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.101922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=1ee0b2255cbf41fe9a777949eff22087) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:19.102172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:19.102289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.102934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.108091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.113550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:18 2022] GET /identity/v3/role_assignments?user.id=1ee0b2255cbf41fe9a777949eff22087&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:19.115261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.217602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68550ce-2ad0-48df-b5d4-0d299e70abe9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.228330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0bb99-05a5-44f6-8846-8a6f695d2897 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.259869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.260601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.260891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.261175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.262459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.264016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.265898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 43/88] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:19.270816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.273503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.274141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.274424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.274700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.275377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.276855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.303181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 46/89] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:19 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:19.304023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.307064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.309694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.412825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27afdf-d00f-4efc-b1ff-a040600aa411 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.427953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a57ae-ac13-4d22-a5eb-7f6495733e8f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.464590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.465378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.465736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.466085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.467341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.467960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.468786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.469033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.469479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.469928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.471330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:19.472255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.551650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.553278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.555278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.603412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.607055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953c5c-c9b6-47e8-bc86-e5c1c022fec6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.651259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.651879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.652169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.652449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.685831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 47/91] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:19.686696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.736901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.739202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.813667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473e29-a66a-4aef-84a3-4e6f331dc718 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:19.815827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.872224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:19.872847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:19.873134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:19.874343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:19.875095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:19.875408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:19.876861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:19.882073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:19.884994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:19.885831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:19.892811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 45/93] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:19.902227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:20.102256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5908d3-2065-45a7-83b6-573d3c49b184 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:20.145413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:20.147046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:20.147331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:20.147610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:20.151870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:20.156098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:20.159896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adce70-ab59-42dd-b69b-f35e85d4a6fd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:20.161614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 49/94] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:20.164365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:20.240205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:20.241861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:20.243696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:20.243696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:20.243696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] PATH_INFO: `/v3/projects/86f9c5e602fe4daab67b7abaa885a12e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:20.246426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] RBAC: Authorizing `identity:get_project(project_id=86f9c5e602fe4daab67b7abaa885a12e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:20.247896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:20.249625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 46/95] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:19 2022] GET /identity/v3/projects/86f9c5e602fe4daab67b7abaa885a12e => generated 312 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:20.276261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:20.391067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e029726-9a4f-41a5-b8bb-63c54d3a765e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:20.417757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:20.473732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77c50-ad2d-40d7-a982-4a30b469a24a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:20.490324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:20.491269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:20.491748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:20.492219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:20.493156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:20.493743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:20.495421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13c77-8ccd-4865-ae7d-32e739e7400e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:20.501531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:20 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:20.512990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:20.514021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:20.514611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:20.515088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:20.516054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=86f9c5e602fe4daab67b7abaa885a12e, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:20.516667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:20.518410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6521c-adbe-4840-b8f7-4f2ff4f09f5a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:20.525008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:20 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=86f9c5e602fe4daab67b7abaa885a12e&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:21.685024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93212-767d-4c8f-a516-629abc68c2a9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:21.686060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93212-767d-4c8f-a516-629abc68c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:21.686542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93212-767d-4c8f-a516-629abc68c2a9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:21.688114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:21.694068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa02-6382-41cf-b48f-b7f6e46291ad None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:21.694890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa02-6382-41cf-b48f-b7f6e46291ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:21.695384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa02-6382-41cf-b48f-b7f6e46291ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:21.718222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6006aa02-6382-41cf-b48f-b7f6e46291ad None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:21.719845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6006aa02-6382-41cf-b48f-b7f6e46291ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:21.810237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:22.335826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93212-767d-4c8f-a516-629abc68c2a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:22.419869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0842ea-4947-420a-9a77-b57402cb8962 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.420501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0842ea-4947-420a-9a77-b57402cb8962 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.421005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0842ea-4947-420a-9a77-b57402cb8962 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.422827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 49/100] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:22.430477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.430838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.431118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.458959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:22.460161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:22.497364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:22.514009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93212-767d-4c8f-a516-629abc68c2a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:22.552228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:22.571287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:22.589264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:22.589846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.590127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.590403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.608985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c2eb189c-cb64-4efd-9bb1-e1edf075d72d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:22.614115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:22.614973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:22.615723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:22.622546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:22.742503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc0ae9-050e-4cb9-a0b5-753e593c6eb7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:22.755583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926314c-4633-4cf4-aafd-d4cbf3ad894a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.756045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926314c-4633-4cf4-aafd-d4cbf3ad894a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.756242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926314c-4633-4cf4-aafd-d4cbf3ad894a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.757580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 53/103] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:22.762631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.762913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.763732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.803474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:22.804917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:22.818354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:22.819178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:22.819712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:22.820130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:22.821016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:22.821489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:22.823020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:22.839429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:22.844296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:22.934152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 54/105] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 05 13:57:22.944824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:22.992816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d21e-3bbe-4331-ac8c-37660021b945 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.029617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.030738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.031243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.031830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.033777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:23.035270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009878-30c7-44ab-a4d0-40c43d612858 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:23.037518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:22 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:23.044137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.164963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76645d-2073-4fe9-95c3-33054b767543 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.165292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76645d-2073-4fe9-95c3-33054b767543 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.165479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76645d-2073-4fe9-95c3-33054b767543 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.167039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 53/107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:23.172396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.172697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.172983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.176230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:23.196849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d01b-8dfd-473f-9450-722f72ae3550 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.205214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:23.206443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:23.258733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.259893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.260910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.261890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.263998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:23.268515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:23.271268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 55/108] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:23 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:23.276559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.325905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:23.333395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.444114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4f87-1924-4f53-8e3a-880fb3285389 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.458356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:23.517010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.517756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.518045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.518325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.543075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:23.549673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:23.550624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:23.551933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:23.558349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f1ba-1e80-4ce1-8952-a863934d893d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.562077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.590604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:23.621797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.622474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.622763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.623051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/1ee0b2255cbf41fe9a777949eff22087/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.628924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, user_id=1ee0b2255cbf41fe9a777949eff22087, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:23.632714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:23.660233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 55/111] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:23 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/1ee0b2255cbf41fe9a777949eff22087/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:23.661915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.743485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df8140-5779-4292-b8c6-e8d0f2a2cf7c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.792830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a358-7242-426d-888f-8c505b9198e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.812199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:23.838689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.840156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.840699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.841156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.842911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:23.844610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:23.845162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:23.845541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.845924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.846214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.846975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:23.847295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:23.849419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:23.850641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.853427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab15c5-0837-4ddb-8665-928abbc376fa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:23.865338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:23.872181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962874b-3332-4289-817e-6d2f86cedfed None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:23.872476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962874b-3332-4289-817e-6d2f86cedfed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:23.873508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962874b-3332-4289-817e-6d2f86cedfed None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:23.874259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 57/114] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:23.875285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962874b-3332-4289-817e-6d2f86cedfed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:23.960090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:23.977677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033a230-7bf4-4821-a446-46a37467770c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:23.998228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962874b-3332-4289-817e-6d2f86cedfed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.012792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.013466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.013746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.014033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.025666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:24.030955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:24.031787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 58/115] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:24.034128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.039705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.040395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.040752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.041118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.041862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:24.043394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634156-779a-462d-b721-0494ebc73b96 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:24.072012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 58/116] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:57:23 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:24.073194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471f7f-f64b-41f7-b45e-beeb7a133f6e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.073536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471f7f-f64b-41f7-b45e-beeb7a133f6e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.073814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69471f7f-f64b-41f7-b45e-beeb7a133f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.101986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-69471f7f-f64b-41f7-b45e-beeb7a133f6e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:24.103911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-69471f7f-f64b-41f7-b45e-beeb7a133f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:24.136210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.148649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95d72-9fe5-4c36-934d-450b3533ff00 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.189836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.190684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.191016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.191296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] PATH_INFO: `/v3/users/2946c40ffd964f24af51605a5a56ecfd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.206613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 59/117] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:24.209096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] RBAC: Authorizing `identity:get_user(user_id=2946c40ffd964f24af51605a5a56ecfd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:24.209466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50375ba-34e5-4a37-98dc-43d9fd0fd01f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.209930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50375ba-34e5-4a37-98dc-43d9fd0fd01f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.210381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50375ba-34e5-4a37-98dc-43d9fd0fd01f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.210996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:24.212117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 60/118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:24.216340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/users/2946c40ffd964f24af51605a5a56ecfd => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:24.216340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.218451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.218965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.219420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.219519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.242778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:24.245021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:24.336617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 61/120] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:24.337543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.345724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b03d3-b1bb-404d-b603-149f4da25054 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.416086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.416711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.416998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.417295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.417974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:24.418279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:24.419911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:24.438824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 60/121] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:24.444782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.488041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.519999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a3c3-725e-4758-8628-3a5b45df7c30 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.555055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.592961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.593596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.593887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.594169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.624040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2e70-a08c-42bc-83f6-e25ab68894c9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.685788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:24.687259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:24.692356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.693002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.693310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.693588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.699358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:24.701073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:24.703130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 61/122] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:24.703909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.825626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f87e-ec34-4305-a6a7-c9e51d12aff2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.827468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.847628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:24.848988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.857531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:24.863064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:24.864237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:24.865030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:24.865827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:24.877331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:24.883867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:24.884857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:24.885801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 62/124] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:24.886620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:24.971819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cc2d0-71b9-4fc1-b50e-1221952057e1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:24.995053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c7be2-5a2e-4527-9308-0ca7560b034a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.015609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.016490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.017459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.017886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.019578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.022031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.024529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.025904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.032311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.033067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.033465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.033849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.045465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:25.051483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:25.052366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:25.053135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 63/126] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:25.053797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.107630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.115460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.164055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff81e-9ecc-4e39-9323-a24e8c232a4f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.173523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe9787-5a88-4878-99f5-0f32e0fc5235 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.206294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.207329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.207735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.208510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.210051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.212582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.214347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 64/127] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.215185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.216968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.217991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.218425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.218966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.220603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:25.221065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.222639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.233904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 64/128] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.235441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.343889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b39d86-4a79-45bb-ab44-4600004d4825 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.362482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0b3e7-76ad-496b-9234-15a077cd4998 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.371559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.378701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.384185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.385010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.385509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.385938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/a546e9619a2647578f92c00eb32a8a75/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.388081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, user_id=a546e9619a2647578f92c00eb32a8a75, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.389735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.405452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.406219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.406596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.407047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.407693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 65/129] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:25 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/a546e9619a2647578f92c00eb32a8a75/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:25.407936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:25.408316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.409178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.410057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.427992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 65/130] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.427992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.600903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba2c5-6192-4f74-853a-fa9d90635465 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.635701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597014-11eb-407c-9d85-62dc6f3228f8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.648815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.649527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.649814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.650091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.650883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=2946c40ffd964f24af51605a5a56ecfd) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:25.651206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.652648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.661811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 66/131] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/role_assignments?user.id=2946c40ffd964f24af51605a5a56ecfd&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.662767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.675109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.676057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.677088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.677579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.679059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.680749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.682961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 66/132] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.692351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.750596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.783599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:25.851588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b48b-d789-4b2c-9c1f-036719a8620c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.856051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178e32-19e6-456c-bd62-169c919caa33 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:25.893781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.894397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.894624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.894955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] PATH_INFO: `/v3/projects/86f9c5e602fe4daab67b7abaa885a12e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.896126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] RBAC: Authorizing `identity:get_project(project_id=86f9c5e602fe4daab67b7abaa885a12e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.897775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.899701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/projects/86f9c5e602fe4daab67b7abaa885a12e => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.904959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:25.915582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:25.916293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:25.916578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:25.916857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:25.921030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:25.922532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:25.924142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 67/134] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:25.932030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:26.101464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358b-a59b-4175-ab6d-b552848e6496 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:26.118004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:26.131326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607e20-b87d-4022-89ce-2428d553768a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:26.146361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:26.146981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.147322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.147608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.150531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:26.151021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:26.152008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:26.153687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 68/135] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:25 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:26.159906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:26.187182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:26.187854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.188137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.188413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] PATH_INFO: `/v3/projects/86f9c5e602fe4daab67b7abaa885a12e/users/a546e9619a2647578f92c00eb32a8a75/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.191442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] RBAC: Authorizing `identity:create_grant(project_id=86f9c5e602fe4daab67b7abaa885a12e, user_id=a546e9619a2647578f92c00eb32a8a75, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:26.195079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022399e-414f-4327-985d-a0ea122384bb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:26.217699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 68/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:25 2022] PUT /identity/v3/projects/86f9c5e602fe4daab67b7abaa885a12e/users/a546e9619a2647578f92c00eb32a8a75/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:57:26.218976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05960-843b-4cb5-a85b-928543b53c63 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.219263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05960-843b-4cb5-a85b-928543b53c63 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.219540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05960-843b-4cb5-a85b-928543b53c63 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.222702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 69/137] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:26.229807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.230150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.230367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.265958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:26.267187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:26.363582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f898593-7f75-46c6-8203-c547517aee59 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:26.405590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 70/138] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:26.429744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:26.430428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.430710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.431130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/a546e9619a2647578f92c00eb32a8a75/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.433365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, user_id=a546e9619a2647578f92c00eb32a8a75, role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:26.435047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:26.470441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:26 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/a546e9619a2647578f92c00eb32a8a75/roles/a539e6faf0104fb0a48571ee19579d1e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:57:26.779635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:26.887838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f58a2d-5856-499d-9f39-3fd55cdb9f5b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:26.889528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:26.931948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:26.932673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:26.932866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:26.933145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:26.945199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9034e7d6-6c98-46b9-afba-801c8c88defd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:26.950214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:26.951051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:26.952225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 71/140] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:26.957167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:27.020732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:27.093902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dfbce-0bc5-4dee-9113-3ea638a3b9e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:27.112077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108b6f-f5ee-4ba2-9435-e07307ba6ba6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.112613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108b6f-f5ee-4ba2-9435-e07307ba6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.112613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108b6f-f5ee-4ba2-9435-e07307ba6ba6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.114525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 72/141] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:27.119692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.119967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.120241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.139349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:27.140531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:27.143049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:27.143960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.144257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.144539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.145806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:27.146126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:27.147512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:27.157574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 70/142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:27.168064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:27.300148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:27.317797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c58815-91cf-4c98-a727-0f22a9c7ecf8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:27.320217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:27.360793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:27.361382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.361680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.361959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] PATH_INFO: `/v3/users/1ee0b2255cbf41fe9a777949eff22087` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.363097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] RBAC: Authorizing `identity:get_user(user_id=1ee0b2255cbf41fe9a777949eff22087)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:27.365158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:27.366762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:27 2022] GET /identity/v3/users/1ee0b2255cbf41fe9a777949eff22087 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:27.372560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:27.491722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:27.505303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c56c4-7055-46f3-8594-8dd28ba828f9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:27.545439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:27.546103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.546389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.546742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.622613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:27.624028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:27.735012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:27.750526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 74/145] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:27.756594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:27.826506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:27.900119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb461e-8c97-45ac-8f3e-9b3d78b20b9a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:27.950694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:27.951725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:27.952222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:27.952709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:27.954141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:27.955791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:27.961067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:27 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:27.967450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:28.039395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597291d9-5c76-4759-befd-ad336ba77ae2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:28.041614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:28.116713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc33f1-bb15-49a3-835c-51387ed4a7d3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:28.126588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:28.127240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:28.127522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:28.127798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:28.133921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:28.135405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:28.137009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:28.142660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:28.164826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:28.165400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:28.165777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:28.166061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:28.169248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=1ee0b2255cbf41fe9a777949eff22087) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:28.169248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:28.169443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ade5-cecf-4205-9862-1ab49dd6b525 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:28.187415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:27 2022] GET /identity/v3/role_assignments?user.id=1ee0b2255cbf41fe9a777949eff22087&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:28.286332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:28.347986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417324b-ceaa-4543-9e5d-03ef7a2c8767 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:28.404510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:28.405151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:28.405463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:28.405744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:28.406422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:28.407881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdc647-4047-4f4b-8595-3ebc25e0d912 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:28.448028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 76/149] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:28 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:28.687078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bc4b-0c92-4190-88ff-a1c715245baa None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:28.687454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bc4b-0c92-4190-88ff-a1c715245baa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:28.687645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bc4b-0c92-4190-88ff-a1c715245baa None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:28.689356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 74/150] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:28.696012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2792e6-5af7-40c9-b9d9-67f884991e26 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:28.696012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2792e6-5af7-40c9-b9d9-67f884991e26 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:28.696012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2792e6-5af7-40c9-b9d9-67f884991e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:28.723696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bc2792e6-5af7-40c9-b9d9-67f884991e26 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:28.725208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc2792e6-5af7-40c9-b9d9-67f884991e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:28.823803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 77/151] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:29.009420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e8a5-2fa3-45b6-829f-b665f3bb21d8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.009921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e8a5-2fa3-45b6-829f-b665f3bb21d8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.010028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5e8a5-2fa3-45b6-829f-b665f3bb21d8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.011560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 75/152] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:29.016785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.017119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.017418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.040105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:29.041305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:29.097563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.130251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 78/153] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:29.147937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e8a5-2fa3-45b6-829f-b665f3bb21d8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.268610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5e8a5-2fa3-45b6-829f-b665f3bb21d8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.272047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.318287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.319283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.319770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.320248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.335329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:29.340591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:29.341517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:29.342316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:29.344737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 76/154] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:29.351283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.440394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.482551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7b34-7f62-4761-808e-7cbba150f45e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.532138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.533096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.533665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.534151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.535122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:29.535636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:29.537821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:29.546872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 79/155] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:29.556068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.577858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc0ec-75e5-42ec-91da-a86caebe8eda None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.603195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.621258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.621258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.621258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.621258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.635074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-711d58de-61c1-4925-9eee-fc4daec4b484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:29.640716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:29.641900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:29.642767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:29.643871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 77/156] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:29.644854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acab6-e037-4964-9948-c1e99a48639c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.645195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acab6-e037-4964-9948-c1e99a48639c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.650407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acab6-e037-4964-9948-c1e99a48639c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.652752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 78/157] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:29.657578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.658372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.658657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.680075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:29.681328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:29.682094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee688-e33d-413e-abab-15ccc5460d81 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.705629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.724654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.725673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.725956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.726225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.727385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:29.728842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:29.730819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:29.731422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.769434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:29.770876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:29.891310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25438e-9615-4210-a2e4-a7514c2f2925 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.899298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.905253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab20ed-c577-4fb7-a559-83e4fee4d74f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:29.934545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.935171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.935455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.935734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.936468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:29.936782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:29.938209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66db62-c8cd-4993-af8d-b293a3cfb249 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:29.947656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 81/160] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:29.948401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:29.948980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470374-3394-467b-bda8-029e0da13059 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.949085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.949316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470374-3394-467b-bda8-029e0da13059 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.949428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.949616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.949781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470374-3394-467b-bda8-029e0da13059 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.952447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 82/161] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:29.956776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:29.957068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:29.957376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:29.976623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:29.981495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:29.982625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:30.026922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.028476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.055834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 83/162] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:30.062110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.173750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 80/163] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:30.181426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.237818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:30.244764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02884ba-e6d9-4a24-9d1a-8c38272bdaad None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.284274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:30.314981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.315577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.315788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.316065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] PATH_INFO: `/v3/users/2946c40ffd964f24af51605a5a56ecfd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.322002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] RBAC: Authorizing `identity:get_user(user_id=2946c40ffd964f24af51605a5a56ecfd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.323692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.325343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/users/2946c40ffd964f24af51605a5a56ecfd => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:30.326200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.336002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dd50e-5dac-4501-b8a9-6dcb0c60f909 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.378394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.380079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.380666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.381131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.386678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.388391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.390267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:30.391459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.502827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41726ce9-20d0-415b-9c9b-ae23d66f742b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.538265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.538817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.539097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.539373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.548248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5da32-3b1d-411b-89cb-121329474773 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.549759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:30.555075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:30.555954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:30.556953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 85/166] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:30.561946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.578280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:30.592459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.593523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.594003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.594484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.595636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:30.596945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.599290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.601179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:30.602161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.676991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de069-7ce2-45bc-8aab-0b0cb50855b0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.715487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.716106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.716390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.716673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.717418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:30.717731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.722767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.735976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:30.738081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.809279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47622649-09ff-4964-99e8-00085eafff2e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.882681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.882881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c4e35-33b5-4741-8f56-d943e2d134f8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:30.883250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.883595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.883872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.917597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:30.921933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:30.924122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:30.924812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:30.925183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:30.925628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:30.926446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:30.926958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:30.928632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:30.928918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:30.929815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:30.930596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:30.941274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 83/169] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:30.943170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:30.948326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 87/170] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:30.950590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.035384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.093349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6210a7f-8b2b-414e-add8-6a1e5223765f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.131287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.131911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.132197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.132469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.133709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.135356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.136967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 88/171] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:30 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:31.139893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7b4d9-b1f8-42ef-a9da-77498c26e273 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.142143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.169583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.205501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.206269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.206659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.206946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/2946c40ffd964f24af51605a5a56ecfd/roles/11b3ccdcef77475cb096d86d0d368964` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.214717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, user_id=2946c40ffd964f24af51605a5a56ecfd, role_id=11b3ccdcef77475cb096d86d0d368964)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.216171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.246611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 84/172] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:30 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/users/2946c40ffd964f24af51605a5a56ecfd/roles/11b3ccdcef77475cb096d86d0d368964 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:31.247555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.251532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8730-fa82-4322-bb0e-80bdba52632e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.297046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.297609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.297890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.298164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.298854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:31.299183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.302562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.321656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 89/173] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:31.342781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.481741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cfc87-03bb-46df-b3ac-451b86971ae5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.506375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.521611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.539899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.541322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.541954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.542471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.583537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32103d-5afc-4ea0-a4f7-8d1d86f57288 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.639500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.641124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.679307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.679956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.680235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.680509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] PATH_INFO: `/v3/users/a546e9619a2647578f92c00eb32a8a75` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.685898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] RBAC: Authorizing `identity:get_user(user_id=a546e9619a2647578f92c00eb32a8a75)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.687407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.689052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/users/a546e9619a2647578f92c00eb32a8a75 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:31.695093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.786726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 85/175] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:31.798581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:31.812570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.874333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a662-1e01-49fe-a548-0a334807a158 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.912699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e632d54-b862-4347-80f3-da0497278089 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:31.921400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.922409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.922900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.923379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.946018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:31.949998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:31.951270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:31.951541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:31.951817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] PATH_INFO: `/v3/projects/86f9c5e602fe4daab67b7abaa885a12e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:31.953099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] RBAC: Authorizing `identity:get_project(project_id=86f9c5e602fe4daab67b7abaa885a12e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:31.954579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:31.965259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 86/176] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/projects/86f9c5e602fe4daab67b7abaa885a12e => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:31.968360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:32.037940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:32.040223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0d1fc-7545-4b9c-9a56-ca3acbf24dbe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:32.121573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:32.151887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3b1df-f598-413a-9b5d-f4fc2f3f387b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:32.191111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:32.192537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.193017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.193513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.194428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=86f9c5e602fe4daab67b7abaa885a12e, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:32.194941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:32.196553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:32.207450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 87/177] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=86f9c5e602fe4daab67b7abaa885a12e&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:32.238449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:32.245906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:32.358875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347cc2-2a59-4446-b4ed-278e995c1284 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:32.395550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:32.396545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.397020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.397516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.399261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:32.400995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963db63b-7de0-4fd1-9f36-5f9eb5f0bddb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:32.402989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9790df-9ada-4c59-8cc6-fa247bac3e52 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.403513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9790df-9ada-4c59-8cc6-fa247bac3e52 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.403981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9790df-9ada-4c59-8cc6-fa247bac3e52 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.405605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 92/179] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:32.407663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 88/180] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:32 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:32.414394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9790df-9ada-4c59-8cc6-fa247bac3e52 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:32.424029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f9d4d-c895-4597-ac56-e83fb4c8f83d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.426036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f9d4d-c895-4597-ac56-e83fb4c8f83d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.426036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f9d4d-c895-4597-ac56-e83fb4c8f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.466269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c40f9d4d-c895-4597-ac56-e83fb4c8f83d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:32.467498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c40f9d4d-c895-4597-ac56-e83fb4c8f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:32.474904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:32.490699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:32.542109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9790df-9ada-4c59-8cc6-fa247bac3e52 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:32.587138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:32.587815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.588121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.588390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.592722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=a546e9619a2647578f92c00eb32a8a75) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:32.593046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:32.594549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cadc-8d3f-4757-bde9-be5f0be757c0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:32.605762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 93/181] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:32 2022] GET /identity/v3/role_assignments?user.id=a546e9619a2647578f92c00eb32a8a75&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:32.659813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 89/182] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:32.676203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844080c-4a6c-4c19-a1bf-2570a0904ca0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.677123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844080c-4a6c-4c19-a1bf-2570a0904ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.677439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844080c-4a6c-4c19-a1bf-2570a0904ca0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.679088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 94/183] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:32.685115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:32.685427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:32.685707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:32.722357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:32.724337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:32.828734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 90/184] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:32.975382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844080c-4a6c-4c19-a1bf-2570a0904ca0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.093437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844080c-4a6c-4c19-a1bf-2570a0904ca0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.110239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.134434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.135065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.135342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.135612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.146457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:33.151575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:33.152457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:33.153270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 95/185] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:33.158565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.199402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.251545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.286750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b4e1e-d8d0-4f5e-aa6b-3d283e792065 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.318224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fd2-b1d6-44f3-a82a-b8a98c5aff2f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.328156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.329186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.329497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.329825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.330509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:33.330810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:33.333157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c21b8-8ab8-435e-a900-f4d41c9aebdd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:33.346090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 91/186] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:33.350605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784664-4c03-4a27-8000-fddeccbc8b96 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.351047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784664-4c03-4a27-8000-fddeccbc8b96 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.351324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784664-4c03-4a27-8000-fddeccbc8b96 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.352568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 92/187] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:33.353286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784664-4c03-4a27-8000-fddeccbc8b96 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.365473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.366369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.366860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.367322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.378182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ef504ce4-ac8f-4efb-a494-3ebdffc03015 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:33.383796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:33.384872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:33.385816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:33.387613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 96/188] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:33.392319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.392319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.392319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.412946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:33.414156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:33.441785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.464475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784664-4c03-4a27-8000-fddeccbc8b96 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.482666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 97/189] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:33.483726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.495320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.501120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.502235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.502728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.503292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.521146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:33.523208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:33.529376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 93/190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:33.531387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.625666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6945db-28d5-4358-a1c6-a24af88de290 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.646675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778369-ab33-463e-9e99-47531db2f71f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.674487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.675656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.676082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.677326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.678726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:33.679460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:33.681321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:33.683207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.684098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.684277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.684659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.691876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:33.698481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.735245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.762313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.776988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:33.780079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:33.825375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecebc-391a-44d8-96d6-e10982ec6131 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.862185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:33.862828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:33.863112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:33.863391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:33.865715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:33.867561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:33.869673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 99/192] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:33.874864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.891624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 94/193] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:57:33.892321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:33.978447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.985593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd737b94-b404-41ff-8499-181a53266f52 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:33.986660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:33.997788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af07b-d79b-42c2-9ce4-42bc64089c87 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.022243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.023128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.023549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.023963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.025248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.027335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.029706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 100/194] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:34.031445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.033516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.034639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.035097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.035540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.110771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.112261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.138862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941471a-0db5-41d9-857a-ad4936adf795 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.175170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.175928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.176249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.177075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.178254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.179709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.181371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 101/195] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:34.182115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.211583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:34.214799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:34.223029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 95/196] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:34.224421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.283965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c33fe6-44ae-46a6-afc2-ef5397017099 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.316286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.316889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.317165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.317488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.318208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.319660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e4e6c-0c52-497a-81ec-d5ac085c7e72 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.322085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616f7c-ff46-4078-9bf0-289d54bb51be None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 102/197] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:34 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da6a0-6462-4efc-8d20-caeb468fb558 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da6a0-6462-4efc-8d20-caeb468fb558 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da6a0-6462-4efc-8d20-caeb468fb558 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 103/198] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:34.339597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da6a0-6462-4efc-8d20-caeb468fb558 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.358772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.359402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.359686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.359964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.360713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=4e03bbb4f4904e7c9575ae7e3044a267) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:34.361048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.362554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861106aa-6b18-4b26-9753-d2dd11ffb61f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.369044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 96/199] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/role_assignments?user.id=4e03bbb4f4904e7c9575ae7e3044a267&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:34.374779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.375139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.375325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.396533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:34.397836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:34.459340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:34.481306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 97/200] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:34.513957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:34.530407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da6a0-6462-4efc-8d20-caeb468fb558 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.571061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.571634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.571916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.572194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.573410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.574874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.576728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 104/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:34.582632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.695847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689567-f587-4680-9e23-82d303f9a785 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.733182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.734111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.734598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.735062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.735970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=4e03bbb4f4904e7c9575ae7e3044a267) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:34.736455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:34.738167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:34.744853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 98/202] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/role_assignments?user.id=4e03bbb4f4904e7c9575ae7e3044a267&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:34.775591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:34.904479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6b29-ac31-43da-82de-994a173b8c02 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:34.941625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:34.943294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:34.943806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:34.944285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:34.960097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:34.965612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:34.966478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:34.967246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 105/203] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:34.973022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:35.055374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:35.126052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b931-eece-4d94-a843-27fdffbbc184 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:35.174938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:35.175473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:35.175754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:35.176033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:35.177271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:35.177583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:35.178964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:35.189062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 99/204] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:35.195401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:35.218248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:35.316212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f1c-7507-4ceb-a43d-bac3584d576a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:35.352382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:35.353040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:35.353305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:35.353584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] PATH_INFO: `/v3/users/2946c40ffd964f24af51605a5a56ecfd` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:35.354715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=2946c40ffd964f24af51605a5a56ecfd)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:35.356165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:35.358323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 106/205] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:35 2022] GET /identity/v3/users/2946c40ffd964f24af51605a5a56ecfd => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:35.364984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:35.511133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d055a-f2c9-4baa-8e01-ac0aec6c1670 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:35.524496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:35.553442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:35.554063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:35.554347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:35.554630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:35.650643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:35.652113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:35.771362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 100/206] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:35.776833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:35.864692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:35.883679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b7b7-3a06-4526-a28e-6ed0230ad0b6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:35.918328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:35.918968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:35.919248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:35.919523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:35.920700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:35.922178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0376808-f60b-4bf3-8e68-a7c335bddf98 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:35.923798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 107/207] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:35 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:35.929670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:35.941524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:36.034166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e395f2-3218-4612-8b24-3122a9edaec9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:36.068822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:36.069446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:36.069727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:36.070000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:36.070725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, scope.project.id=807d893b41b345c48b3bcae2ad4a1034, user.id=2946c40ffd964f24af51605a5a56ecfd) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:36.071035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:36.072531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afc40a-a36b-44af-88d9-f6084afd7dd0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:36.078265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 101/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:35 2022] GET /identity/v3/role_assignments?user.id=2946c40ffd964f24af51605a5a56ecfd&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:36.931102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b34b-1cbe-4da4-9e74-61e5a0f17b5d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:36.931606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b34b-1cbe-4da4-9e74-61e5a0f17b5d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:36.931715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4b34b-1cbe-4da4-9e74-61e5a0f17b5d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:36.933255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 108/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:36.938545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de6a-d090-4c9f-a8b7-3869daa653bb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:36.938954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de6a-d090-4c9f-a8b7-3869daa653bb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:36.939118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de6a-d090-4c9f-a8b7-3869daa653bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:36.958810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e936de6a-d090-4c9f-a8b7-3869daa653bb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:36.960002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e936de6a-d090-4c9f-a8b7-3869daa653bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:37.029219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 102/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:37.248162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d330-2257-4543-aa51-1278acbed6f0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.248553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d330-2257-4543-aa51-1278acbed6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.248756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003d330-2257-4543-aa51-1278acbed6f0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.250400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 109/211] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:37.256830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.257438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.257924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.265405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:37.273446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222781a3-a672-450a-991d-975a0486fcd5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.273728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222781a3-a672-450a-991d-975a0486fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.274011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222781a3-a672-450a-991d-975a0486fcd5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.275345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 110/212] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:37.279581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:37.280257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73044-a50b-4aed-91f8-ece1234d0a35 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.280536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73044-a50b-4aed-91f8-ece1234d0a35 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.280804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73044-a50b-4aed-91f8-ece1234d0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.281639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:37.298419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dea73044-a50b-4aed-91f8-ece1234d0a35 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:37.299580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dea73044-a50b-4aed-91f8-ece1234d0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:37.361742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 103/213] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:37.366440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.374673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 111/214] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:37.375975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aec-4fe4-47d4-b3f6-8d5df5222a29 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.376326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aec-4fe4-47d4-b3f6-8d5df5222a29 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.376601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53aec-4fe4-47d4-b3f6-8d5df5222a29 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.377978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 112/215] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:37.383768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.383886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.384099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.401788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:37.402963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:37.484249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 113/216] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:37.504079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6fb8-0fae-41e2-8f18-873a40f8a799 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:37.539945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:37.540907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.541423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.541895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.543844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:37.553694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:37.558831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:37.559708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:37.560515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:37.563119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 104/217] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:37.570592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.583350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:37.647139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.681128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc16330-b761-4466-afe9-e75b4e37b947 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:37.715223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:37.715835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.716100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.716369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.717031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:37.717365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:37.718734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:37.729261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 114/218] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:37.729261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.769616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f0241-891c-4c0a-85e8-f7732d18c646 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:37.806558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:37.811671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:37.812419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.812732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.812883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.823001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:37.827790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:37.828642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:37.829472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 105/219] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:37.830125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.838719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19bee7-72f5-494e-a5e5-a3adf43a7874 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:37.872991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:37.873648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.873931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.874206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.875309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:37.876754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:37.878437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 115/220] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:37.879196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.886890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:37.931546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c539-7606-456e-b1c6-ae847fd5de7a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:37.964515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:37.965140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:37.965448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:37.965725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:37.966852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:37.968318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:37.969932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 106/221] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:37.970694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:37.981668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373fa2c-0791-4083-a33c-f897206c0bbb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.014214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.014841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.015123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.015403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.023155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.026852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:38.031802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:38.032686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:38.033532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 116/222] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:38.034232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.070384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e217-0744-4acf-9d0b-ecb444c82d53 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.092431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.109470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.110058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.110351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.110630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.111303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:38.111609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.115485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.122865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 107/223] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:38.128001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.133689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a686-1a8f-4cd0-a0e7-c18b8518b4d1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.171536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.172146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.172426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.172707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.173389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.174852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.195494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 117/224] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:38 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:38.196651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.242632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fdfc8-e881-494b-a2ff-11ca392249a3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.261614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.281266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.282399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.282399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.282597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.283653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.285127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.292572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 108/225] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:38.292572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.322083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be366bd-fdff-45d0-b9a1-073b236c4abb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.359313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.359891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.360502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.360772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.361035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.361737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:38.362044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.363485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.379829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 118/226] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:38.379829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.420756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da7e0-5a1b-4b25-bef3-1ad34a58c85d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.467661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.468309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.468586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.468860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] PATH_INFO: `/v3/users/2de32d3a77844ccca4a81bd64481dcbe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.486358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] RBAC: Authorizing `identity:get_user(user_id=2de32d3a77844ccca4a81bd64481dcbe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.487937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.490617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 109/227] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/users/2de32d3a77844ccca4a81bd64481dcbe => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:38.491437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.501351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246111-592f-4687-8868-189fab4af4fd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.524466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.547361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.547955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.548237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.548811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/4e03bbb4f4904e7c9575ae7e3044a267/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.550447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, user_id=4e03bbb4f4904e7c9575ae7e3044a267, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.552570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.566895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 119/228] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:38 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/4e03bbb4f4904e7c9575ae7e3044a267/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:38.568159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.647077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b415ff-5a16-4b77-b578-4d0040db4e76 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.667483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.723798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.725520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.725837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.726123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.730025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.731522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.737610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 110/229] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:38.740368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:38.743014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a272-df71-4478-9d1a-57c29d344b67 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.816051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.816678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.816999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.817301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.886712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:38.900233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fddbb7-b96a-4b07-805c-6af7162aaa82 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:38.928793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.930323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.944441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67566086-29c3-4509-afdb-4909b383748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:38.945132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566086-29c3-4509-afdb-4909b383748f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:38.945467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566086-29c3-4509-afdb-4909b383748f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:38.945738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566086-29c3-4509-afdb-4909b383748f None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:38.946860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566086-29c3-4509-afdb-4909b383748f None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:38.948308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566086-29c3-4509-afdb-4909b383748f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:38.950236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 111/230] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:38.956967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67566086-29c3-4509-afdb-4909b383748f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:39.050711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:39.090726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 120/231] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:39.096500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:39.172178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67566086-29c3-4509-afdb-4909b383748f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:39.211431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:39.212092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:39.212371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:39.212645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/4e03bbb4f4904e7c9575ae7e3044a267/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:39.216088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, user_id=4e03bbb4f4904e7c9575ae7e3044a267, role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:39.219158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:39.223283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:39.244440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 112/232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:38 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/4e03bbb4f4904e7c9575ae7e3044a267/roles/a539e6faf0104fb0a48571ee19579d1e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:39.262301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc011e-844b-418d-87dd-6fbcbfd5dc2e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:39.312499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:39.313243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:39.313530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:39.313806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:39.318330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:39.319888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d2d88-a392-4a06-a99c-f0c2bd10fade None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:39.321729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 121/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:39 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:39.328190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:39.470779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73a45-1f22-4ecd-bb5f-03fb0fb414a1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:39.484498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:39.519456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:39.520793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:39.521527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:39.522003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:39.522962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=2de32d3a77844ccca4a81bd64481dcbe) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:39.523497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:39.525195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63015bb-fa56-4195-9716-2159409a53a6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:39.531861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 113/234] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:39 2022] GET /identity/v3/role_assignments?user.id=2de32d3a77844ccca4a81bd64481dcbe&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:41.039270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeea2c-51d8-46df-8248-c1001353826e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.039776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeea2c-51d8-46df-8248-c1001353826e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.039776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeea2c-51d8-46df-8248-c1001353826e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.041349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 122/235] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:41.046391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb29-9256-47ee-be89-852fa8dc2c59 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.046783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb29-9256-47ee-be89-852fa8dc2c59 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.046992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb29-9256-47ee-be89-852fa8dc2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.074216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3fa7eb29-9256-47ee-be89-852fa8dc2c59 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:41.075403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fa7eb29-9256-47ee-be89-852fa8dc2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:41.156158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 114/236] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:41.233460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0d492-d1d2-4496-95c3-7e81570c2c87 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.233784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0d492-d1d2-4496-95c3-7e81570c2c87 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.234013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0d492-d1d2-4496-95c3-7e81570c2c87 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.235759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 123/237] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:41.241321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af281c1-0f9f-41c8-98c2-88e93bc38d66 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.241616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af281c1-0f9f-41c8-98c2-88e93bc38d66 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.241883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af281c1-0f9f-41c8-98c2-88e93bc38d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.263342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9af281c1-0f9f-41c8-98c2-88e93bc38d66 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:41.264529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9af281c1-0f9f-41c8-98c2-88e93bc38d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:41.331234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 115/238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:41.337553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de7cd5-8931-4f25-896d-83a8c6991342 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.337839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de7cd5-8931-4f25-896d-83a8c6991342 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.338114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de7cd5-8931-4f25-896d-83a8c6991342 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.339435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 124/239] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:41.344607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.344900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.345183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.371475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:41.372663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:41.404527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:41.463501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 116/240] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:41.506220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de7cd5-8931-4f25-896d-83a8c6991342 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:41.636093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de7cd5-8931-4f25-896d-83a8c6991342 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:41.670967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:41.671601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.671878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.672148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.683363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:41.688488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:41.689392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:41.690785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 125/241] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:41.692989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:41.696614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:41.707114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:41.819106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6e3ab-7294-464c-8ec4-79ac93e4f4ce None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:41.856234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:41.856942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.857292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.857575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.858246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:41.858548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:41.860156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:41.869705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 126/242] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:41.870649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:41.885890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64ac6-4816-4bfe-acc0-49ea6ae26fdd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:41.938996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:41.939600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:41.939928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:41.940205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:41.941362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:41.942890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:41.944857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 117/243] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:41.945660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:41.950292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:41.975733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.003620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd706a-b796-40f4-b9c7-d48d0cdb1253 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.055953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.057288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.057496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb5ab-c679-43ec-bf63-cf1cdc64010a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.058165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.058575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.075187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:42.082297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:42.083916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:42.084867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:42.087804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 127/244] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:42.088693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.104457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.104833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.105205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] PATH_INFO: `/v3/users/b3b40fd023cb47b898ec66db1f76925f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.119804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] RBAC: Authorizing `identity:get_user(user_id=b3b40fd023cb47b898ec66db1f76925f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.121528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.127774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 118/245] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:41 2022] GET /identity/v3/users/b3b40fd023cb47b898ec66db1f76925f => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:42.127774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.202672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440587d9-b4d4-4f57-84fe-9e7a2b358968 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.217442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.231392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.234271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da156af-d0c9-463c-9464-d5ae5a183fcf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.241455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.242093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.242365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.242639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.243314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.244835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.268186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 128/246] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:42 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:42.269024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.275560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.276190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.276471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.276746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.277564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:42.278101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.279740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aabed-3d23-4ce3-bee4-ab5e74416576 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.297269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 119/247] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:42.297269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a1d-9166-4f8e-a178-54293e170612 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.297521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a1d-9166-4f8e-a178-54293e170612 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.297713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1559a1d-9166-4f8e-a178-54293e170612 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.303219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 120/248] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:42.304418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1559a1d-9166-4f8e-a178-54293e170612 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.406210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084de2d2-d90c-4c81-9a5d-b000e90feb4d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.443188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1559a1d-9166-4f8e-a178-54293e170612 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.444578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.444727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.444928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.445174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.482369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.483010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.483293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.483568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.484901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.486386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baf65f-9260-4c90-91d3-a7cddd09e3c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.493414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 121/249] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:42 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:42.493414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3832-86ee-4a32-b5e8-341f0b97e2fc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.493414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3832-86ee-4a32-b5e8-341f0b97e2fc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.493414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3832-86ee-4a32-b5e8-341f0b97e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.510074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a67a3832-86ee-4a32-b5e8-341f0b97e2fc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:42.510313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.511571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a67a3832-86ee-4a32-b5e8-341f0b97e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:42.524633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.530987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.532562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bfc51-9d06-45a2-9f9e-4161d95483a3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.600124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 122/250] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:42.601604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fef7-0590-413a-8e69-2b7b46ce5be1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.601966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fef7-0590-413a-8e69-2b7b46ce5be1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.602317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9fef7-0590-413a-8e69-2b7b46ce5be1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.604887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 123/251] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:42.604887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9fef7-0590-413a-8e69-2b7b46ce5be1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.672263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 129/252] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:42.673689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.674155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.674513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.699434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:42.700918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:42.717963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9fef7-0590-413a-8e69-2b7b46ce5be1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.758836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.759824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.760247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.760656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:42.778311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.792361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 130/253] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:42.793585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:42.824602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:42.873985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:42.875524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:42.959522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72aa79-fe9b-417b-add9-e28905ca39bd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:42.996893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:42.997995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:42.998480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:42.998954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.000306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.002004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.004942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 131/254] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:42 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.010606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.100582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 124/255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:43.102129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.125630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.147543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0f25-67a1-4b83-ae37-3ace16142f01 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.166065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.190697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.191677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.192713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.193215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.204672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:43.210191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:43.211085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:43.211869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:43.214251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 132/256] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:43.219806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.226219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bfc9a-5c0e-45d2-a4b7-a223747c7d14 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.273117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.273677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.273951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.274253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.275110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=b3b40fd023cb47b898ec66db1f76925f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:43.275418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.276852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.284469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 125/257] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/role_assignments?user.id=b3b40fd023cb47b898ec66db1f76925f&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.289317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.378842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99bff5-7603-474e-8b26-c6f3477e7a21 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.400986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27207-94b3-4eff-934c-b9ce0351579c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.414323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.442564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.443219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.443497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.443776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.457299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:43.459421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.460427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.460908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.461402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:43.463764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:43.464696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:43.465529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:43.467367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.469074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.471158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.471391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 126/259] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:43.472311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.472673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.491355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.616481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490662f-a792-4919-8b5a-e8b968ea5ad1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.626089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc9ec-a2e3-4025-9c71-f658db343f03 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.673807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.674813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.675648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.676126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.677079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:43.677620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.679756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.688874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.689552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.689798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.690168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.690384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 134/260] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.691362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.696771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:43.696771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.696771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.715667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 127/261] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.716532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.790773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.824945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90ab8-f4a8-4a45-9e44-85bf48c92f90 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.838569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:43.865349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:43.866887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:43.867429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:43.867903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:43.868825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=4e03bbb4f4904e7c9575ae7e3044a267) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:43.869426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:43.871556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:43.878598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 135/262] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/role_assignments?user.id=4e03bbb4f4904e7c9575ae7e3044a267&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:43.880445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:43.981583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506975b-5848-428e-a4be-02b9049e1627 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:43.996919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c3c18-91b4-4d47-8260-7ad2d5abf804 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.019324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.019965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.020292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.020571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] PATH_INFO: `/v3/users/2de32d3a77844ccca4a81bd64481dcbe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.021828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] RBAC: Authorizing `identity:get_user(user_id=2de32d3a77844ccca4a81bd64481dcbe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.023290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.029255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 128/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/users/2de32d3a77844ccca4a81bd64481dcbe => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:44.031591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:44.044528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.045187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.045505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.045781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] PATH_INFO: `/v3/users/4e03bbb4f4904e7c9575ae7e3044a267` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.046976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] RBAC: Authorizing `identity:get_user(user_id=4e03bbb4f4904e7c9575ae7e3044a267)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.048918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.052064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 136/264] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:43 2022] GET /identity/v3/users/4e03bbb4f4904e7c9575ae7e3044a267 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:44.058468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:44.063980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:44.164575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:44.171403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89397102-8836-4fc3-97b9-ab587b5bb959 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.206087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee3e4-0f91-4bc7-8c25-476fa3d45563 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.216867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.218207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.218675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.219448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.221166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.223499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.226422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:44 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:44.232218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:44.249563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.250268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.250622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.250984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.346134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.347751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.350568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53166c5b-7c68-4d9a-9220-ddf56d07aae9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.351917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:44.396418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.397188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.397587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.397951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/2de32d3a77844ccca4a81bd64481dcbe/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.400166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, user_id=2de32d3a77844ccca4a81bd64481dcbe, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.401741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.417914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 130/266] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:44 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/2de32d3a77844ccca4a81bd64481dcbe/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:44.490697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 137/267] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:44.497600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:44.557608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:44.639705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273d2-9c52-497c-a72f-ccf3741d417b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.679331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.679895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.680180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.680461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.681691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.683135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214edcaf-9e96-4f20-b81b-970ce7e820fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.685139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 131/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:44 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:44.691054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:44.823943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3609d0-96bb-4620-81ef-97e3d71db922 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:44.826342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:44.866644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:44.867274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:44.867546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:44.867822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:44.868621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=4e03bbb4f4904e7c9575ae7e3044a267) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:44.868935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:44.870422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02784f20-b7ed-4b95-b16d-9b01ecb72953 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:44.876687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 138/269] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:44 2022] GET /identity/v3/role_assignments?user.id=4e03bbb4f4904e7c9575ae7e3044a267&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:45.158645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d82b4-23a1-4a03-b503-fabcb42f0e3d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.159016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d82b4-23a1-4a03-b503-fabcb42f0e3d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.159193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d82b4-23a1-4a03-b503-fabcb42f0e3d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.160982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 132/270] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:45.167003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.167283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.167556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.187320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:45.188492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:45.261500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84d33-b72b-4ffc-a9e8-1faa9cd31a24 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.262021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84d33-b72b-4ffc-a9e8-1faa9cd31a24 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.262021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84d33-b72b-4ffc-a9e8-1faa9cd31a24 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.263384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 133/271] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:45.268662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.268954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.269266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.271376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 139/272] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:45.294035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:45.295559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:45.371468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 134/273] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:45.559426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:45.658004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:45.664049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:45.664370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e8a68-3eb3-4f50-911c-0d4535424278 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:45.692707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:45.704244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:45.704901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.705180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.705481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.718707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:45.724645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:45.725845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:45.726650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:45.730692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 140/274] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:45.731995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:45.792199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8161-fe99-46ae-95c0-fde74d7bb0a9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:45.835038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:45.835849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.836216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.836582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.837799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:45.839458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:45.845507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 135/275] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:45.846754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:45.855951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe88c-477f-48de-92c5-6c71edc5c54b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:45.892517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:45.893146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:45.893466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:45.893739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:45.894399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:45.894698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:45.896802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:45.910211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 141/276] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:45.911526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:45.934594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:45.964284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:45.972634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981fef-7316-4e62-a4c1-e6a6cadcb323 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:46.019019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:46.020134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.021434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.022147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.023008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:46.023984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76903-7855-4006-bc82-ed85bf8cc3b5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:46.024838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:46.069276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 136/277] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:57:45 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:46.069488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151d319-7430-40ae-9745-55e440165349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:46.069488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d319-7430-40ae-9745-55e440165349 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.069488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d319-7430-40ae-9745-55e440165349 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.069488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151d319-7430-40ae-9745-55e440165349 None admin] PATH_INFO: `/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.095145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151d319-7430-40ae-9745-55e440165349 None admin] RBAC: Authorizing `identity:get_user(user_id=1e8b2a2631c84dc394c5d8fe37bedab4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:46.097036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151d319-7430-40ae-9745-55e440165349 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:46.104375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 142/278] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:45 2022] GET /identity/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:46.106142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:46.170716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66ddb-3fb1-47d8-8891-9933c371d351 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.171006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66ddb-3fb1-47d8-8891-9933c371d351 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.171285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66ddb-3fb1-47d8-8891-9933c371d351 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.172925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 143/279] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:46.178922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.179266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.179552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.199314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:46.200697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:46.221591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24ecc1-612d-4bde-9b4f-a4f961255eb3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:46.264906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:46.265610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.265844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.266117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.266863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, user.id=1e8b2a2631c84dc394c5d8fe37bedab4, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:46.267173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:46.268650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:46.274322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 137/280] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 13:57:46 2022] GET /identity/v3/role_assignments?user.id=1e8b2a2631c84dc394c5d8fe37bedab4&scope.system=all&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:46.280613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 144/281] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:46.556925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:46.574843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:46.689605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b6053-4aaf-4119-9ee7-bc7b5362aa4b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:46.728440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:46.729078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.729401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.729749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.740356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:46.745256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:46.746123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:46.746899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 138/282] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:46.753872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:46.769591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:46.904014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ac85-4c5a-4c30-81bd-e3ea8659f7e4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:46.950927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:46.951549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:46.951832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:46.952107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:46.952784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:46.953089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:46.954530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebc20-7892-4ee4-98d4-1a5b7bbb4238 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:46.968240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 145/283] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:46.973795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:47.087115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:47.121919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6f878-b54c-4a31-9afd-1fd7ce41ecf7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:47.124161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af85bf-5031-4e9f-ad92-81789991bbd3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.124447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af85bf-5031-4e9f-ad92-81789991bbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.124725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af85bf-5031-4e9f-ad92-81789991bbd3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.126246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 146/284] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:47.132356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.132915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.133417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.166835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:47.167957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:47.191227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:47.191971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.192769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.193045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] PATH_INFO: `/v3/users/b3b40fd023cb47b898ec66db1f76925f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.195518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b40fd023cb47b898ec66db1f76925f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:47.197001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:47.198646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 139/285] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:46 2022] GET /identity/v3/users/b3b40fd023cb47b898ec66db1f76925f => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:47.205157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:47.300843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:47.309923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 147/286] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:47.355845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7436564-19ae-47c1-8e4d-61191a1e1445 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:47.391700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:47.392330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.392606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.392878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.394026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:47.395508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:47.397443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 140/287] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:47 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:47.406269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:47.540323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d5f3-19ec-4ce2-8bb1-ae02cd20d638 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:47.587791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:47.588515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.588801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.589078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/b3b40fd023cb47b898ec66db1f76925f/roles/11b3ccdcef77475cb096d86d0d368964` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.591083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, user_id=b3b40fd023cb47b898ec66db1f76925f, role_id=11b3ccdcef77475cb096d86d0d368964)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:47.592528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:47.615345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:47.617161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 148/288] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:57:47 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/users/b3b40fd023cb47b898ec66db1f76925f/roles/11b3ccdcef77475cb096d86d0d368964 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:47.632318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:47.752255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfd58-2857-4fa3-aa9f-d1de86a3881a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:47.802511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:47.803082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.803362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.803634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.819101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:47.824063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:47.824993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:47.825845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 141/289] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:47.833440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:47.915385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:47.961058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ea46-4244-4148-95bd-bfb23325e0a3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:47.996842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:47.997491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:47.997771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:47.998043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:47.998770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:47.999078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:48.000564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:48.009167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 149/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:48.014669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:48.117617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:48.157618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47514883-3e7a-4a83-871b-e608dba4b8f5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:48.191604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:48.192765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.193046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.193348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] PATH_INFO: `/v3/users/2de32d3a77844ccca4a81bd64481dcbe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:48.194486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=2de32d3a77844ccca4a81bd64481dcbe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:48.195922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:48.197707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 142/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:48 2022] GET /identity/v3/users/2de32d3a77844ccca4a81bd64481dcbe => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:48.203071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:48.311912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb75d-fa2b-48d7-9675-f3ec9ac3710a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:48.336181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:48.348620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:48.349324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.349606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.349926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:48.421346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:48.422739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:48.536346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 150/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:48.542357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:48.646879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a472827-1209-4d74-b45d-2c9251ea8cd6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:48.682202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:48.682759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.683033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.683306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:48.684423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:48.685900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ac2ef-5b60-4341-b7aa-30b6ad0fdb63 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:48.687951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 143/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:48 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:48.694358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:48.718595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:48.798737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd275b-d0b2-4d3a-969e-f7c1c68a3af9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:48.851481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:48.852110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.852391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.852722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:48.853497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=2de32d3a77844ccca4a81bd64481dcbe) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:48.853852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:48.855318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf58ed-ac1b-4370-852e-d49f54a30201 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:48.864484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 151/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:48 2022] GET /identity/v3/role_assignments?user.id=2de32d3a77844ccca4a81bd64481dcbe&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:48.982177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5207-4f81-46b9-a387-9a46eddc22ab None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.982555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5207-4f81-46b9-a387-9a46eddc22ab None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.982712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff5207-4f81-46b9-a387-9a46eddc22ab None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:48.984482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 144/295] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:48.991409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66121e-bfdd-4149-9665-326e90ef83f6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:48.991705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66121e-bfdd-4149-9665-326e90ef83f6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:48.991954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66121e-bfdd-4149-9665-326e90ef83f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.010765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ee66121e-bfdd-4149-9665-326e90ef83f6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:49.011985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee66121e-bfdd-4149-9665-326e90ef83f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:49.091869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea960-9111-4d73-944f-de45f6c5b203 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.092621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea960-9111-4d73-944f-de45f6c5b203 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.093105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea960-9111-4d73-944f-de45f6c5b203 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.096335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 145/296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:49.103146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8401b-927d-48d3-b45f-ada87f4a4698 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.103769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8401b-927d-48d3-b45f-ada87f4a4698 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.104248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8401b-927d-48d3-b45f-ada87f4a4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.112943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 152/297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:49.119504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.126130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-90a8401b-927d-48d3-b45f-ada87f4a4698 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:49.127560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-90a8401b-927d-48d3-b45f-ada87f4a4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:49.209330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 146/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:49.304218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebe74-1c11-4765-a277-2cd9c6dc7aef None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.304419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebe74-1c11-4765-a277-2cd9c6dc7aef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.304916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebe74-1c11-4765-a277-2cd9c6dc7aef None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.306745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 153/299] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:49.311607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.311901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.312184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.334083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:49.335268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:49.412902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:49.439059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceebe74-1c11-4765-a277-2cd9c6dc7aef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.459770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.512137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.566347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceebe74-1c11-4765-a277-2cd9c6dc7aef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:49.590968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.609144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:49.609814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.610096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.610375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.623905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:49.630328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:49.631254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:49.632046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 154/301] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:49.639829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.642771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de2abb-19a7-4d9b-b550-d17808af89ac None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:49.685893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:49.686880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.687385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.687987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.700566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:49.706830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:49.709672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:49.711796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 148/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:49.714181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.730269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.756910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cab22-bc41-45b2-91d0-02c84cce8e2c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:49.793068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:49.793380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.793663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.793936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.794603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:49.794930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:49.796314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:49.805299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 155/303] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:49.810583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.828258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbb9dc-4bf2-47dd-b7b0-565ce8c29e08 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:49.856124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.866267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:49.866893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.867170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.867440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.868535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:49.870014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:49.876211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 149/304] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:49.876843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.919736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912659c6-ce87-4f95-8d9f-e01c6cbdf70e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:49.955889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:49.956498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:49.956780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:49.957049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:49.958318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:49.958619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:49.960003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:49.965012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:49.969003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 156/305] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:49.969764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:49.996748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457575a3-1f4a-476c-aa78-c17bad811d7f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.034074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.034702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.034991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.035257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] PATH_INFO: `/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.037039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] RBAC: Authorizing `identity:get_user(user_id=1e8b2a2631c84dc394c5d8fe37bedab4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:50.038522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:50.040710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 150/306] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:49 2022] GET /identity/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:50.041177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:50.076223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40883283-423e-4ed0-b099-23da65ed6f99 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.105149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:50.111592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.112210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.112495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.112785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] PATH_INFO: `/v3/groups` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.113443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:50.115175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:50.130997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 157/307] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 5 13:57:49 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:57:50.137174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:50.157908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72391-f24a-4f15-8cbb-09d214a5ad98 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.212359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.213326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.214551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.215039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] PATH_INFO: `/v3/users/79bbac536ee94ed8828f32ec21cecc22` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.223039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:50.234799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] RBAC: Authorizing `identity:get_user(user_id=79bbac536ee94ed8828f32ec21cecc22)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:50.237568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:50.245588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 151/308] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:50 2022] GET /identity/v3/users/79bbac536ee94ed8828f32ec21cecc22 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:50.247289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:50.280476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf226c-b1c8-4338-997f-0c57e4d3552d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.326745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.327074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.327344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.328289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] PATH_INFO: `/v3/system/users/1e8b2a2631c84dc394c5d8fe37bedab4/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.329293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e8b2a2631c84dc394c5d8fe37bedab4, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:50.330706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267946cb-cb57-4d34-88e4-538421b411b3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:50.339789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 158/309] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 5 13:57:50 2022] PUT /identity/v3/system/users/1e8b2a2631c84dc394c5d8fe37bedab4/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:50.341206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdaa2-bb66-48f3-abbc-15bf746e088e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.341524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdaa2-bb66-48f3-abbc-15bf746e088e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.341803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdaa2-bb66-48f3-abbc-15bf746e088e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.343127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 159/310] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:50.349692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.350265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.350747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.373467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:50.375259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:50.377093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc0116-ed5d-47f7-ab55-f332c26360de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.401318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:50.425377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.426001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.426843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.427126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.427881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, user.id=79bbac536ee94ed8828f32ec21cecc22, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:50.428194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:50.429716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:50.435715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 152/311] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 13:57:50 2022] GET /identity/v3/role_assignments?user.id=79bbac536ee94ed8828f32ec21cecc22&scope.system=all&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:50.472121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 160/312] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:50.741276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:50.847761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e1e70-5fe5-4b71-b5b3-8b76f67210d4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:50.882869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:50.883506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:50.883798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:50.884067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:50.894512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:50.899922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:50.900813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:50.902036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 153/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:50.907148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:50.967832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:51.019245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079130f-88cc-428c-80f3-945249ec2320 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:51.055203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:51.055816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:51.056095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:51.056368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:51.057031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:51.057361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:51.058846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:51.068023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 161/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:51.073791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:51.122601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:51.184191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11064f65-4345-4ee7-9012-7072886cfeb7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:51.222011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:51.222645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:51.222928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:51.223238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] PATH_INFO: `/v3/users/b3b40fd023cb47b898ec66db1f76925f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:51.224394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b40fd023cb47b898ec66db1f76925f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:51.225878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:51.227823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 154/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:51 2022] GET /identity/v3/users/b3b40fd023cb47b898ec66db1f76925f => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:51.233730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:51.339078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58fd-9246-464c-b32b-0d14b91c8db0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:51.355989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:51.375878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:51.376516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:51.376796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:51.377074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:51.452387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:51.453865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:51.557209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:51.562594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:51.666243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d093e-14db-4ce4-a317-673738794611 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:51.679665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:51.703064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:51.703698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:51.703980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:51.704255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:51.705422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:51.706879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2737f8-8cbe-4a73-8590-ce593851f50d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:51.709409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 155/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:51 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:51.715280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:51.733604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:51.817701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965574e0-0013-4183-a7f0-fabf995d0147 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:51.855112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:51.855708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:51.855984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:51.856251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:51.856974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4, user.id=b3b40fd023cb47b898ec66db1f76925f) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:51.857298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:51.858719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739b4f-e85b-46c1-8a70-a35ded4a55e1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:51.864999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 163/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:57:51 2022] GET /identity/v3/role_assignments?user.id=b3b40fd023cb47b898ec66db1f76925f&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:52.479822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a00-cb71-4daa-bc35-7a29b20e7ace None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.480337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a00-cb71-4daa-bc35-7a29b20e7ace None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.480412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a00-cb71-4daa-bc35-7a29b20e7ace None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.482024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 156/319] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:52.487769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccfa0d-868d-4050-9f78-a1c36d3a38ff None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.488062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccfa0d-868d-4050-9f78-a1c36d3a38ff None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.488342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccfa0d-868d-4050-9f78-a1c36d3a38ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.508017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dfccfa0d-868d-4050-9f78-a1c36d3a38ff None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:52.509201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dfccfa0d-868d-4050-9f78-a1c36d3a38ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:52.557789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8858-0516-45b6-a0a1-785577933138 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.558074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8858-0516-45b6-a0a1-785577933138 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.558348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8858-0516-45b6-a0a1-785577933138 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.559720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 157/320] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:57:52.565593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa305-df16-4e85-8981-cc3adbc97c71 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.565875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa305-df16-4e85-8981-cc3adbc97c71 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.566351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa305-df16-4e85-8981-cc3adbc97c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.583532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 164/321] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:52.585976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a13fa305-df16-4e85-8981-cc3adbc97c71 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:52.587203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a13fa305-df16-4e85-8981-cc3adbc97c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:52.655114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 158/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:57:52.685887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9276-3323-43ce-b444-b7774e7966ef None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.686169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9276-3323-43ce-b444-b7774e7966ef None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.686450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b9276-3323-43ce-b444-b7774e7966ef None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.687919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 165/323] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:52.692805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466710-808f-4546-9582-059e0a48220c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:52.693099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466710-808f-4546-9582-059e0a48220c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:52.693410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466710-808f-4546-9582-059e0a48220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:52.711020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4d466710-808f-4546-9582-059e0a48220c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:52.712191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d466710-808f-4546-9582-059e0a48220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:52.781349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 159/324] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:52.861045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9276-3323-43ce-b444-b7774e7966ef None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:52.874213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:52.932380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d466710-808f-4546-9582-059e0a48220c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:52.970172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b9276-3323-43ce-b444-b7774e7966ef None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:52.979732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.006027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.006683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.006964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.007236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.008319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.009801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.011368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 166/325] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:57:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:53.016868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.044517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d466710-808f-4546-9582-059e0a48220c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.077599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.078215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.078488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.078757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.088991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:53.093776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:53.094775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:53.095739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 160/326] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:53.096842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.096915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.120126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad4615-83f1-4da1-808e-751a2ab09510 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.152241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.152846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.153131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.153429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] PATH_INFO: `/v3/groups` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.154051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.155486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.170870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 167/327] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 5 13:57:53 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:57:53.172020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.210497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.214743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0564274-00b2-44e8-8752-a430cd458b0d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.261680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.262450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.262851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.263259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.276214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:53.281267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:53.282188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:53.282966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:53.288851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.307649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc217910-ddd6-4882-9345-b1a2f7ec2ff0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.345382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.345715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.345950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.346217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.346944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:53.347179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.349277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.354659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.362089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 168/329] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:53.367829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.401348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22410100-80d5-4714-9258-fb72ea7d37b8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.449761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.449761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.449761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.450132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.450624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:53.450926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.452292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.463869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 162/330] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:53.468915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.486031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ca88b-41a7-47e2-b32a-a6d0b751a658 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.498828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.535204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.536353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.536633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.536906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] PATH_INFO: `/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.538233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] RBAC: Authorizing `identity:get_user(user_id=1e8b2a2631c84dc394c5d8fe37bedab4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.539708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.546098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/users/1e8b2a2631c84dc394c5d8fe37bedab4 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:53.547125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.606958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14cd13-554f-4100-911b-56d84feb2559 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.645691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.670266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.670915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.671196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.671476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] PATH_INFO: `/v3/users/79bbac536ee94ed8828f32ec21cecc22` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.673140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] RBAC: Authorizing `identity:get_user(user_id=79bbac536ee94ed8828f32ec21cecc22)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.674766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.677272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/users/79bbac536ee94ed8828f32ec21cecc22 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:53.683523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:53.695637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae71538-2090-44a7-8d98-24e6603a84af None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.734624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.735399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.735878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.736388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.737561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] RBAC: Adding query filter params (role.id=931034f8100747f0bd80ac5bdb966b9a, user.id=1e8b2a2631c84dc394c5d8fe37bedab4, scope.system=all) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:53.737878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.739368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfce9c-acb1-40cf-8815-1a352ac909b1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.752486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 13:57:53 2022] GET /identity/v3/role_assignments?user.id=1e8b2a2631c84dc394c5d8fe37bedab4&scope.system=all&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:53.809634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:53.818183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af2203-0dff-4e12-a942-31e0db9e09ef None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:53.862801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:53.863415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:53.863693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:53.863998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] PATH_INFO: `/v3/system/users/79bbac536ee94ed8828f32ec21cecc22/roles/11b3ccdcef77475cb096d86d0d368964` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:53.870073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=79bbac536ee94ed8828f32ec21cecc22, role_id=11b3ccdcef77475cb096d86d0d368964)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:53.871508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16696d4-9fe0-43f3-94d2-9ebd453cd5c3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:53.883212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 5 13:57:53 2022] PUT /identity/v3/system/users/79bbac536ee94ed8828f32ec21cecc22/roles/11b3ccdcef77475cb096d86d0d368964 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:57:55.969313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c506d-5487-4cc4-a120-3771f461973b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:55.969806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c506d-5487-4cc4-a120-3771f461973b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:55.969906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c506d-5487-4cc4-a120-3771f461973b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:55.971448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:55.978307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:55.979164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:55.979638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:56.005788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:56.007302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:56.021346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3903b58-cfaa-4dc1-8eb9-0f4eb9a2b83c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:56.022369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3903b58-cfaa-4dc1-8eb9-0f4eb9a2b83c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:56.022849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3903b58-cfaa-4dc1-8eb9-0f4eb9a2b83c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:56.029531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 172/336] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:56.031881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:56.032371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:56.033094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:56.068998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:56.070138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:56.139342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 165/337] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:56.191024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 173/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:56.521345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:56.625670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:56.647528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e474255-d46f-4d76-a5c0-1ee4823ae883 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:56.647763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:56.696779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:56.697674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:56.698121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:56.698590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:56.735665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:56.738294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:56.747932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:56.748846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:56.749770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:57:56.752237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 166/339] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:56.758319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:56.797714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8056c9-9d2a-4bc3-b2b4-4ed4aefde264 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:56.858410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:56.859332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:56.859845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:56.860265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:56.876192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:56.881764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:56.882676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:56.883457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:56.890417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 174/340] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:57:56.896355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.051674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e89ff-c4b6-44b4-b300-695446b0a660 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.052153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d5005-527c-49bd-8ffe-fd9fe1bea1c5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.089893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.104380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.105388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.106159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.106641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.107513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:57.108036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.109659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb04aa-bbaf-44b6-ba09-f60bd24e5ba9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.119867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 167/341] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:57.121533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb937-8255-4c07-8ace-ae150d7d3972 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.122025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb937-8255-4c07-8ace-ae150d7d3972 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.122501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adb937-8255-4c07-8ace-ae150d7d3972 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.124187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 168/342] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:57.127965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.128575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adb937-8255-4c07-8ace-ae150d7d3972 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.128681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.128855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.129887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.130707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:57.131158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.132818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24983d82-b9f3-4282-889b-be0e1f85e90b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.141982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.149567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 175/343] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:57:57.151898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.152330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.152786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.182044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:57.183511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:57.254387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adb937-8255-4c07-8ace-ae150d7d3972 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.272298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 176/344] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:57.273566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.291883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.292859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.293249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.293610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.371300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.372576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa4fa-9b63-4e26-a7a5-19559097ffab None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.382118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.394607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ee1e-2d2d-4a88-ad5c-48d42cb4ba07 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.406542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.439222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.440129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.440625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.441177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.496757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:57:57.496757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533c4ba-3318-414a-916c-17cf34a0c009 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.496757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533c4ba-3318-414a-916c-17cf34a0c009 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.496757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533c4ba-3318-414a-916c-17cf34a0c009 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.497156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 170/346] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:57.497909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533c4ba-3318-414a-916c-17cf34a0c009 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.524848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.526778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d1068-7b6a-40ef-927b-9af960a8608a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.615428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533c4ba-3318-414a-916c-17cf34a0c009 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.623897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.646075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:57.647359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.647648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.648040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.653678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.654244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.654518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.654790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.656244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.657812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.659449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 171/348] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:57.660639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.672947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:57.674339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:57.677660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.758914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 178/349] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:57.759895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.780838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3690-5cb1-4e7c-a765-a3589c34067d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.823119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.823794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.824077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.824344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.825678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.827315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.829891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 172/350] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:57.838307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.906049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8398dd-527f-489d-bff0-43aacb695a23 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:57.908841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.948249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:57.949041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.949446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.950336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.958457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:57.960416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd9297-99a3-42e2-8e7f-fc59684eb98b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:57.962858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 179/351] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:57.964433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501ce0c-e84d-498a-8bef-56cea2701813 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:57.964720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501ce0c-e84d-498a-8bef-56cea2701813 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:57.964995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501ce0c-e84d-498a-8bef-56cea2701813 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:57.971427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 180/352] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:57.973594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501ce0c-e84d-498a-8bef-56cea2701813 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:57.977648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:57.994699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284d1f-cc59-4f87-97c0-0454872cebf4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.042403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.043560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.045626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.045914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.047192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:58.048653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:58.053282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 173/353] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:58.053282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.131509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501ce0c-e84d-498a-8bef-56cea2701813 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.183556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.184160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.184443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.184720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.194019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f85e-8989-4e86-9746-4593519267a8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.197200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f4fffb69-4d1f-4120-8740-9cd18ed45e8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:58.202100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:58.203058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:58.204162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 181/354] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:58.205032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.205032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.205032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.208872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:58.224780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:58.226292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:58.240136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.240754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.241038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.241432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.242174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=807d893b41b345c48b3bcae2ad4a1034) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:58.242480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:58.243918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:58.250752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 174/355] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:58.251654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.308673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:58.324754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 182/356] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:58.325172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.390399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475924c5-c1df-4370-bc06-269a41b3d02a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.439198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.440404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.441377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.442428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.443401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=807d893b41b345c48b3bcae2ad4a1034) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:58.443927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:58.446261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dde4a7-af30-4797-8b41-dd4f6faf250f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:58.455394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 175/357] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:58.456757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d81fb-db8d-4e1a-bd91-66886798e169 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.457007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d81fb-db8d-4e1a-bd91-66886798e169 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.457311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d81fb-db8d-4e1a-bd91-66886798e169 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.459915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 176/358] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:57:58.460683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d81fb-db8d-4e1a-bd91-66886798e169 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.465209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ae611-eee2-4218-bcf7-438d719644e8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.509911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.510960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.511448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.512700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:58.513146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.531797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8876fad7-61a3-4cd3-8219-d7fd7885a89c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:58.538956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:58.539928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:58.540760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 183/359] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:58.542197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.542197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.544035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.573442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:57:58.574678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:57:58.605191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d81fb-db8d-4e1a-bd91-66886798e169 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.658584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.659730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.660128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.660504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.661967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:58.662386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:58.664164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:58.665067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:58.677467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 177/360] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:58.678709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.692643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 184/361] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:57:58.701689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.888442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:58.891328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242e632-ec48-4a29-b2dc-187b7a893a4c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.893321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3311e-bb27-44f3-9d3e-de52cf7218e4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:58.949109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.951475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:58.951804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.952289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.953139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:58.953651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.954529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:58.955004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:58.955496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:58.955984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:58.958675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:58.981466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 178/362] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:58.981466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:58.983128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:58.988365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:58.989313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:57:58.990393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:58.993095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 185/363] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:58.997070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.053862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.125245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9a376-8bf3-4471-96f9-1e162d55868e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.134901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cbcf-0e31-4ad4-b998-e13985c48bb8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.166792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.168100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.168595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.169064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] PATH_INFO: `/v3/users/79bbac536ee94ed8828f32ec21cecc22` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.170489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] RBAC: Authorizing `identity:get_user(user_id=79bbac536ee94ed8828f32ec21cecc22)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.172284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.175002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 186/364] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/users/79bbac536ee94ed8828f32ec21cecc22 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:59.175970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.180784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.180784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.180784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.180784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.221252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.269268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.271128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.314299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e2ad-444b-41bb-ab7e-27f2031f8433 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.328230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.366245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.366874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.367158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.367436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.368440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:59.368757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.370437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.381292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 187/365] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:59.382349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.395643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 179/366] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:59.401951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.473647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.513121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36d8f8-60bd-49da-b3d4-ac8c7a30ea5e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.523576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d810e5-fc16-4022-8fb5-206cdf4f4e9a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.561824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.562463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.562751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.563025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.566451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.567331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.567806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.568283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.569421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] RBAC: Adding query filter params (role.id=11b3ccdcef77475cb096d86d0d368964, user.id=79bbac536ee94ed8828f32ec21cecc22, scope.system=all) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:57:59.570356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.573128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.573745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:57:59.580673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:57:59.581603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:57:59.582368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 188/367] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:57:59.583094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.591319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 180/368] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/role_assignments?user.id=79bbac536ee94ed8828f32ec21cecc22&scope.system=all&role.id=11b3ccdcef77475cb096d86d0d368964 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:59.592409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.619803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.700295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b16ac-f733-4d50-b93f-d973ebb55e08 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.742313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.742944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.743228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.743507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.822343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.823844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.849573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bee220-ca55-4b7f-86c7-a69826ca072e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:57:59.889594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.893765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:57:59.927576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:57:59.928515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:57:59.928944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:57:59.929397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:57:59.932726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:57:59.934452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:57:59.939428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 181/369] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:57:59.940454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:57:59.976758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 189/370] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:57:59.977958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.099828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dc3d6-b75c-4418-9ffc-5f70406b2d34 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.106393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c3e2a-b7f5-4bdb-9462-ebf5c8b6fe9a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.147370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.149605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.149727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.149727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.149727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.151167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:00.151167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.152921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.156775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.157715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.158163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.158583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.160473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.162445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.163930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 182/371] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:00.164389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 190/372] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:57:59 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:00.169380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.169941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.234046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.299731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a67047-fb82-4966-8bdc-9862cc018ae4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.307237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad86784-12e3-4b5c-a59e-f4a9bca43748 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.339938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.340558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.340839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.341114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.353615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.354025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.354304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.354581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.355706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.357138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.360732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 183/373] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:00.365745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.429596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.432299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.434064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.491283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb228449-5d11-44f8-bc81-bd21f1002e6d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.514533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.536649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.537659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.538170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.538644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.539573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:00.540086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.541944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.553255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 191/374] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:00.553866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 184/375] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:00.554326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.559516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.685012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.688585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3675-d972-4322-9c71-38457e3617b8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.704197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cb040-7b86-4464-93ed-e36c15ad15e6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.745880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.746841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.747325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.747796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] PATH_INFO: `/v3/projects/385992f3807a48ff8e105d88b2b7542e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.750267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] RBAC: Authorizing `identity:get_project(project_id=385992f3807a48ff8e105d88b2b7542e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.751941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.755483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 185/376] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/projects/385992f3807a48ff8e105d88b2b7542e => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:00.762851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.786217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:00.787297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:00.787773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:00.790698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:00.793645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:00.798685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:00.800723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 192/377] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:00.807110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:00.865640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:00.982880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a267d8-8642-46c1-bb3c-95079eb28f86 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:00.990419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2047f49-bf23-42a4-8a2d-f3b93e00d866 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:01.036119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:01.036739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.037021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.037321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.038067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:01.038379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:01.039834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e7bc9-60f6-4c0d-8ef9-08808b7f2ee4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:01.046912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 193/378] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:01.048241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1731-09c8-4a74-b1fe-b1d2f72675d7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.048523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1731-09c8-4a74-b1fe-b1d2f72675d7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.048797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1731-09c8-4a74-b1fe-b1d2f72675d7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.050046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 194/379] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:01.055026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:01.055630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c748d3-b65b-43ec-84f4-e8e9551f4426 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.055749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.055919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c748d3-b65b-43ec-84f4-e8e9551f4426 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.056009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.056187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c748d3-b65b-43ec-84f4-e8e9551f4426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.056280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] PATH_INFO: `/v3/groups/4c7ec327fc99409fac865fe737bb77be` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.063795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] RBAC: Authorizing `identity:get_group(group_id=4c7ec327fc99409fac865fe737bb77be)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:01.065326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:01.068009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 186/380] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:00 2022] GET /identity/v3/groups/4c7ec327fc99409fac865fe737bb77be => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:01.081352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:01.083444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e9c748d3-b65b-43ec-84f4-e8e9551f4426 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:01.087382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e9c748d3-b65b-43ec-84f4-e8e9551f4426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:01.121429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:01.176010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 195/381] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:01.178652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764962-18bb-4a39-87ab-bdde2a6dbb4c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.179112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764962-18bb-4a39-87ab-bdde2a6dbb4c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.179583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764962-18bb-4a39-87ab-bdde2a6dbb4c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.185712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 196/382] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:01.195660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.196226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.196678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.221255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb72d3-87b3-4edc-89f1-b5eae64e9aff None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:01.234511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:01.235003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:01.236223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:01.260503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:01.261117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.261439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.261727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.262466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] RBAC: Adding query filter params (group.id=4c7ec327fc99409fac865fe737bb77be, role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=385992f3807a48ff8e105d88b2b7542e) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:01.262780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:01.264230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:01.270348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 187/383] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:01 2022] GET /identity/v3/role_assignments?group.id=4c7ec327fc99409fac865fe737bb77be&scope.project.id=385992f3807a48ff8e105d88b2b7542e&role.id=7cd2a85ba9004397b74226de1219a45f => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:01.327022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 197/384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:01.554896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:01.670123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ed22-48ec-4212-84fb-3ecebf472a59 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:01.712352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:01.712996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.713309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.713593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.722841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:01.725589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:01.731224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:01.732106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:01.732898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 188/385] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:01.741657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:01.805414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:01.870567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9a868-8c75-4443-b605-ada1299a34e9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:01.914230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:01.914836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:01.915110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:01.915378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:01.916041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:01.916343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:01.917774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:01.922327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:01.928150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 189/386] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:01.934017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:01.937148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311c5df-8263-43ad-91c3-465a44b9d207 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.006505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.007156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.007439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.007718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.034459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:02.039887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:02.040754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:02.041575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:02.045898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 198/387] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:02.046148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:02.046784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.050298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e806b84-8e29-401e-8424-250aae8ff3d4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.096464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.097016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.097323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.097600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.100337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.101808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.105191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 190/388] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:01 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:02.111056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.235386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10f455-fb58-454a-9fdc-6369fb8c563c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.268629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123f858-0f73-45ed-aa29-4f89e8fdfb4f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.306934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.307568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.307845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.308113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.309266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.310936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.313553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 191/389] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:02 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:02.319802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.321779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.322414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.322691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.322964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.323653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:02.323951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.325351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.342948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 199/390] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:02.350399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.371294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:02.379884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:02.452552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7cdd-5e3b-4598-85df-070402803cb5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.488380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.490174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.490959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.491388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.494179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, group_id=86a714a7b3d24c76bc065fa67f4627d9, role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.495848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.509106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ce49-3671-4661-b73c-bf6085298771 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.523435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 192/391] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 13:58:02 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/a539e6faf0104fb0a48571ee19579d1e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:02.553726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.554419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.554699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.555014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.556171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.557643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.559617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 200/392] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:02 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:02.565176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.670328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:02.677702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3a6a-bba8-4b91-94f8-85abc910eaf3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.715218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.715923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.716208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.716480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.717689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.719141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf8e1f-fc94-4d85-8262-8591a55944df None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.721091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 193/393] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:02 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:02.727057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:02.829452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:02.853163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966c79-b201-441b-9a0e-6623df611535 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:02.895509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:02.896180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:02.896454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:02.896723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:02.898799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] RBAC: Authorizing `identity:create_grant(project_id=807d893b41b345c48b3bcae2ad4a1034, group_id=86a714a7b3d24c76bc065fa67f4627d9, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:02.900239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302a980-9daf-4d6b-a06b-738ada14ec30 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:02.916877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 201/394] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 13:58:02 2022] PUT /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:03.384810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e19-ec71-4310-9c7b-cb4a4fa084cd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:03.385840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e19-ec71-4310-9c7b-cb4a4fa084cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:03.386318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e519e19-ec71-4310-9c7b-cb4a4fa084cd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:03.388090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 194/395] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:03.393653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af3d4-a5b6-448e-8fb6-292b11aad051 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:03.394478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af3d4-a5b6-448e-8fb6-292b11aad051 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:03.395553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af3d4-a5b6-448e-8fb6-292b11aad051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:03.421637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-af8af3d4-a5b6-448e-8fb6-292b11aad051 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:03.422843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-af8af3d4-a5b6-448e-8fb6-292b11aad051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:03.516550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 202/396] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:03.875821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519e19-ec71-4310-9c7b-cb4a4fa084cd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.006191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e519e19-ec71-4310-9c7b-cb4a4fa084cd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.051166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.052715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.053188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.053703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.069681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:04.074892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:04.075791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:04.076693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:04.079401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 195/397] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:04.081338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9513b4e-1743-401f-b55d-a2c2606cc1c4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.081831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9513b4e-1743-401f-b55d-a2c2606cc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.082426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9513b4e-1743-401f-b55d-a2c2606cc1c4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.084295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 203/398] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:04.087509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.105144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbaac-76f8-44fe-b83e-42e363f29421 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.105773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbaac-76f8-44fe-b83e-42e363f29421 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.106240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbaac-76f8-44fe-b83e-42e363f29421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.132183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.136954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9e7fbaac-76f8-44fe-b83e-42e363f29421 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:04.139213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9e7fbaac-76f8-44fe-b83e-42e363f29421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:04.232757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c58b-29d1-48ef-8ea4-ffd6f683a24c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.259617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 204/399] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:04.261379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423fa9-739b-442c-af70-e6d7a12cb696 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.261671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423fa9-739b-442c-af70-e6d7a12cb696 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.261944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423fa9-739b-442c-af70-e6d7a12cb696 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.263871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 205/400] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:04.269060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.269380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.269664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.272399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.273181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.273490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.273764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.274519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:04.274822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:04.276371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:04.276776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.286943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 196/401] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:04.290400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:04.291871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:04.292593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.387553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.394134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 206/402] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:04.402759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099b358-c6e5-4afb-9d65-9ecf29a7dc3e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.438557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.439420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.439857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.440266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.442480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:04.444218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:04.450630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 197/403] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:04.452146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.572906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.597372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c4283-4864-4e25-814e-0e015a91e78a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.633871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.646133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.646780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.647064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.647337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.648595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:04.650163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:04.656460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 207/404] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:04.666477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.693934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49944dd-4a45-4744-8aa1-6a1fd840b5ba None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.728863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.729873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.730347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.730862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.741505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:04.747653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:04.748527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:04.749357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:04.751967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 198/405] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:04.757849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.798084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.807540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184f621-ac09-497b-91be-e90f1622f7f9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:04.844712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:04.845529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:04.845919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:04.846263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:04.848259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, group_id=86a714a7b3d24c76bc065fa67f4627d9, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:04.849811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:04.869505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 208/406] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 13:58:04 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:04.870491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:04.987195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:04.996199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f808-51c1-4993-ad6b-516bc634d232 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.034247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c824f1-53ae-4caa-9a29-afe7507032b3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.074762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.075421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.075699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.075971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.092081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:05.092590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.093582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.094088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.094555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.095443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:05.095970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:05.097496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:05.098442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:05.099255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 209/407] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:05.100579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.107244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.116114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 199/408] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:05.121937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.210401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.234324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6b75-c4a3-494d-81ab-784cb784238d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.246053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd917-479a-4131-bd78-f58e4a838931 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.269496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.270169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.270454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.270732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.271863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.272652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.273725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.275667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 200/409] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:05 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:05.282437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.290493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.291372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.291844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.292755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.293680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:05.294542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.296436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.307610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 210/410] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:05.314231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.463887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e96cc1-2420-4d14-a7ce-212f6ca54789 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.493129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba677dcf-2eb4-46fe-b319-e636fd76cbc9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.500820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.501428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.501716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.501992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] PATH_INFO: `/v3/groups/4c7ec327fc99409fac865fe737bb77be` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.503214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] RBAC: Authorizing `identity:get_group(group_id=4c7ec327fc99409fac865fe737bb77be)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.504904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189defb-e426-4140-865a-48b41bb76e6a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.506726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 211/411] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:05 2022] GET /identity/v3/groups/4c7ec327fc99409fac865fe737bb77be => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:05.507946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4d78-d3fc-4ba1-945d-eddfe9af25eb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.508221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4d78-d3fc-4ba1-945d-eddfe9af25eb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.508491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4d78-d3fc-4ba1-945d-eddfe9af25eb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.514783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 212/412] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:05.515578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb4d78-d3fc-4ba1-945d-eddfe9af25eb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.532765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.533536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.533822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.534102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.535235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.537349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96e484-73c3-43fe-8810-e6d288aae51f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.539405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 201/413] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:05 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:05.545067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.545067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.545067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.564182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:05.565471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:05.573061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.585868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.666080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 202/414] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:05.667473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.673952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb4d78-d3fc-4ba1-945d-eddfe9af25eb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.737586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.739173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.740301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.741008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] PATH_INFO: `/v3/projects/385992f3807a48ff8e105d88b2b7542e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.743366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] RBAC: Authorizing `identity:get_project(project_id=385992f3807a48ff8e105d88b2b7542e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.747011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.750903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 213/415] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:05 2022] GET /identity/v3/projects/385992f3807a48ff8e105d88b2b7542e => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:05.760237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:05.870880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f546292-dc5b-4527-b281-859f9ab7595e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.909905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.911212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.911493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.911763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.914627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cb39a8c7f42ed9abb95787f726fe4, group_id=86a714a7b3d24c76bc065fa67f4627d9, role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.917018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271fb4-14cb-4aa7-99e5-31e30a186952 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:05.926427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f691e-fbff-4334-ae0b-a89d59fd9036 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:05.933680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 203/416] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 13:58:05 2022] PUT /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4/groups/86a714a7b3d24c76bc065fa67f4627d9/roles/a539e6faf0104fb0a48571ee19579d1e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:05.935135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992668-f574-458f-a85a-ec8d58367b35 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.935423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992668-f574-458f-a85a-ec8d58367b35 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.935694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e992668-f574-458f-a85a-ec8d58367b35 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.937357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 204/417] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:05.943676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.943999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.944324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.949616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.954054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:05.970320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:05.971338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:05.971834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:05.972299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] PATH_INFO: `/v3/projects/385992f3807a48ff8e105d88b2b7542e/groups/4c7ec327fc99409fac865fe737bb77be/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:05.974442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:05.975313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=385992f3807a48ff8e105d88b2b7542e, group_id=4c7ec327fc99409fac865fe737bb77be, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:05.975770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:05.977196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:06.015014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 214/418] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 13:58:05 2022] PUT /identity/v3/projects/385992f3807a48ff8e105d88b2b7542e/groups/4c7ec327fc99409fac865fe737bb77be/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:06.060056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 205/419] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:06.087512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:06.228737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa92-f3ca-438e-ac38-0fd3a47054e0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:06.271269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:06.271930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:06.272216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:06.272488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:06.284003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:06.289494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:06.290415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:06.291214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 215/420] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:06.297848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:06.384355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:06.407774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094fd8a-a929-4a71-a805-b0c059126eb2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:06.450826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:06.466458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:06.475338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:06.475956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:06.477674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:06.477952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:06.478623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:06.478928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:06.480293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:06.494191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 206/421] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:06.500196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:06.568655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562e00-8bc9-48e2-b917-652d9bc2606d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:06.611885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:06.612520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:06.612800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:06.613074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:06.626556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:06.633016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:06.633913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:06.635109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 216/422] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:06.644250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:06.677195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fec1-436e-4e0c-80af-6251db801428 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:06.741710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:06.743643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:06.743974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:06.744253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:06.806926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:06.811694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69585-d6a0-4455-92eb-03ad58855cfc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:06.849760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:06.859817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:06.861584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:06.873159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:06.873801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:06.874078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:06.874346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:06.875185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:06.875489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:06.876945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:06.891599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 217/423] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:06.897517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.034842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 207/424] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:07.041102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.084924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc7d7-3fa2-47a8-99dc-2880fe0bb53c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.157780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.158318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.158597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.158866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.213277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:07.233978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:07.244617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4a2c-40bc-4cae-a99d-ee26ac3fa099 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.279936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.281441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697cb3-8dc1-41aa-8d73-cb8d025e90a3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.293684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.294342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.295072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.295356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.296932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.299359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e83f6-46fb-454f-9988-b6fd236ed3bc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.301742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 208/425] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:07.303492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3dd2b-8a51-42d0-91b7-d009d86385be None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.303777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3dd2b-8a51-42d0-91b7-d009d86385be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.304121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3dd2b-8a51-42d0-91b7-d009d86385be None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.305811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 209/426] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:07.307372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3dd2b-8a51-42d0-91b7-d009d86385be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.418675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3dd2b-8a51-42d0-91b7-d009d86385be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.421328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 218/427] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:07.422602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.423169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.423169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.441559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:07.442923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:07.464231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.465202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.465701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.466164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.467470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.469102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.471250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 210/428] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:07.472277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.507145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:07.516024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:07.528616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 219/429] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:07.529998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.608262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693b7b-9b6d-4cf8-b029-662a7b5e9c6b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.641480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a5cd1-f1f4-4c13-871f-05f9afba6605 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.650621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.651262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.651543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.651815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] PATH_INFO: `/v3/projects/807d893b41b345c48b3bcae2ad4a1034` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.653512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] RBAC: Authorizing `identity:get_project(project_id=807d893b41b345c48b3bcae2ad4a1034)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.655406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.657697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 211/430] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/projects/807d893b41b345c48b3bcae2ad4a1034 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:07.662887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.685814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.686843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.687351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.687828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.688804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=807d893b41b345c48b3bcae2ad4a1034) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:07.689375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.691056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.698325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 220/431] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:07.777370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:07.784302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bc0d-664f-4d4e-962e-74776c6b1318 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:07.828834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:07.829521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:07.829816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:07.830081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:07.834405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:07.836135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:07.838044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 212/432] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:07.844027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.889241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:07.947377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.014992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8edd7-20c7-41ce-8aca-899a8099d484 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.019340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6eac0-bd0e-48b3-960a-d9a6c8508f27 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.061674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.062284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.062568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.062844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.063579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=807d893b41b345c48b3bcae2ad4a1034) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:08.063873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.063987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:08.064565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.064853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.065128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.065357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:08.075931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 221/433] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=807d893b41b345c48b3bcae2ad4a1034&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:08.078139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:08.083210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:08.084129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:08.085166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 213/434] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:08.090369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:08.203637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff682-4fa6-403f-9a6c-6967bd5f0336 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.223782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.249553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.250195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.250475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.250750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.251440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] RBAC: Adding query filter params (name=member) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:08.251747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:08.253189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:08.264281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 222/435] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:08.270451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:08.303961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.382344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1da90-b98f-41b5-a03f-60a2952c1a7c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.417679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.418594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.419049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.419492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.492639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:08.494454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd52639-d9a3-4eb6-8c1f-590b7d4b3d91 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:08.525072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.609775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 214/436] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:08.616629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:08.659399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835ada-6495-4667-a4e0-055e3102d6b4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.659722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835ada-6495-4667-a4e0-055e3102d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.659992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1835ada-6495-4667-a4e0-055e3102d6b4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.663231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 215/437] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:08.666644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d9ff-f363-46f7-b506-d5542d15ec9e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.667178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d9ff-f363-46f7-b506-d5542d15ec9e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.667666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d9ff-f363-46f7-b506-d5542d15ec9e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.669069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 216/438] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:08.670065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57b5c-ec26-40ee-9705-a8dd148ffdee None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.670352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57b5c-ec26-40ee-9705-a8dd148ffdee None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.670735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57b5c-ec26-40ee-9705-a8dd148ffdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.691213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dfb57b5c-ec26-40ee-9705-a8dd148ffdee None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:08.692431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dfb57b5c-ec26-40ee-9705-a8dd148ffdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:08.729669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12f85-cfbe-4874-8165-4e77a52d381b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.768705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.769356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.769640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.770555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.771320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 217/439] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:08.772320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:08.772423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.772685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.772959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.773863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:08.775767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 223/440] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:08 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:08.782040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:08.796738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:08.798034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:08.840682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.865641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:08.887030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 218/441] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:08.897403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bffaf-7069-4c19-820f-8e65a6acbef9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:08.931507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:08.932410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:08.932879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:08.933361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:08.934663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:08.936339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:08.942798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 224/442] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:08 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:08.944210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.043842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ae38d-07ce-4dac-b91d-d6422198bb0e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.049566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.080050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.081067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.081428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.081704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.082989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=931034f8100747f0bd80ac5bdb966b9a, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:09.083297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.084838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.091021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 219/443] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:08 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=931034f8100747f0bd80ac5bdb966b9a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:09.156985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d4939-981c-4b96-9bf0-4b14620f366f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.160467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.174687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.194155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.194795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.195072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.195357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.207094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:09.213926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:09.214931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:09.215746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 225/444] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:09.220318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.221352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.290534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e647a-0903-490a-ae32-4c577bcc18d9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.331048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.331716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.331999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.332275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.333900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643683-a94e-48a6-9adf-d34b2b166357 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.349759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:09.354733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:09.355851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:09.356876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 220/445] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:09.363489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.381348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.381744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.382022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.382298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.382962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:09.383860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.384650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.393669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:09.400800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.445464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.484660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a9e45-e74f-42e3-8d7e-0dd9bd5f99be None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.496059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.513653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca364e3-8e99-46f0-bc1a-685df0e08aeb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.520116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.520714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.520990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.521288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.521942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:09.522243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.523606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.532221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 221/447] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:09.538049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.546174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.546780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.547063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.547337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.614242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.615901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.637042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd24-ca1a-4dce-a33e-4ba2adc493b4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.655189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.670684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.671285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.671565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.671837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.711024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.715361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 227/448] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:58:09.721152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.737090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.738604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.821141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d51a49-229e-4200-853e-ce54706a104f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.837290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 222/449] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:58:09.842955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.853977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.854602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.854880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.855153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] PATH_INFO: `/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.856265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] RBAC: Authorizing `identity:get_project(project_id=9a6cb39a8c7f42ed9abb95787f726fe4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.857750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.859342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 228/450] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/projects/9a6cb39a8c7f42ed9abb95787f726fe4 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:09.864745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.873816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.911049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:09.940429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc483-b555-48bc-a613-5da7fa5feae9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.962826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137add5-c2a1-4c5f-ab7e-bdd28c9caf4f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:09.974070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.974686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.974972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.975238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] PATH_INFO: `/v3/projects/385992f3807a48ff8e105d88b2b7542e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.976347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] RBAC: Authorizing `identity:get_project(project_id=385992f3807a48ff8e105d88b2b7542e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.977803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:09.979454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 223/451] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/projects/385992f3807a48ff8e105d88b2b7542e => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:09.984897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:09.995149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:09.995773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:09.996052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:09.996328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] PATH_INFO: `/v3/groups/86a714a7b3d24c76bc065fa67f4627d9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:09.997454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] RBAC: Authorizing `identity:get_group(group_id=86a714a7b3d24c76bc065fa67f4627d9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:09.998888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:10.000703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/groups/86a714a7b3d24c76bc065fa67f4627d9 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:10.006889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:10.078146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:10.082129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90118b-e59e-4572-9386-7ca34d686565 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:10.102331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef237d-b407-44d3-ac4f-8e401de0918b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:10.115021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:10.115857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:10.116130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:10.116399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] PATH_INFO: `/v3/groups/4c7ec327fc99409fac865fe737bb77be` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:10.117538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] RBAC: Authorizing `identity:get_group(group_id=4c7ec327fc99409fac865fe737bb77be)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:10.118972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:10.120512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 13:58:09 2022] GET /identity/v3/groups/4c7ec327fc99409fac865fe737bb77be => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:10.126321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:10.134637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:10.135242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:10.135522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:10.135797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:10.136534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] RBAC: Adding query filter params (group.id=86a714a7b3d24c76bc065fa67f4627d9, role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:10.136685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:10.136830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:10.138293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1487ae-9f9b-47b2-b08f-18b95f44a289 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:10.144132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:10 2022] GET /identity/v3/role_assignments?group.id=86a714a7b3d24c76bc065fa67f4627d9&scope.project.id=9a6cb39a8c7f42ed9abb95787f726fe4&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:10.237073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f4df2-7b4a-4333-b372-ea7f29b4a06d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:10.272471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:10.273072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:10.273380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:10.273651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:10.274375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] RBAC: Adding query filter params (group.id=4c7ec327fc99409fac865fe737bb77be, role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=385992f3807a48ff8e105d88b2b7542e) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:10.274680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:10.276156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efc6fc-a966-4e4d-a7a8-6f7641bd32da None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:10.282507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 225/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 13:58:10 2022] GET /identity/v3/role_assignments?group.id=4c7ec327fc99409fac865fe737bb77be&scope.project.id=385992f3807a48ff8e105d88b2b7542e&role.id=7cd2a85ba9004397b74226de1219a45f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:12.989461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45507d5f-072d-4d73-b96d-1e7a1e059d7a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:12.989971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45507d5f-072d-4d73-b96d-1e7a1e059d7a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:12.990339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45507d5f-072d-4d73-b96d-1e7a1e059d7a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:12.991861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 231/456] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:12.997318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901fa3-2604-40e1-b804-0d01d6df6de1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:12.998115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901fa3-2604-40e1-b804-0d01d6df6de1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:12.998590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9901fa3-2604-40e1-b804-0d01d6df6de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.023210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e9901fa3-2604-40e1-b804-0d01d6df6de1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:13.024729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e9901fa3-2604-40e1-b804-0d01d6df6de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:13.119644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:13.295153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d94e-9483-42bc-a2a8-9ec50c4fe639 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.295503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d94e-9483-42bc-a2a8-9ec50c4fe639 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.295707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d94e-9483-42bc-a2a8-9ec50c4fe639 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.297321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 232/458] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:13.303153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.303444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.303727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.312556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:13.330689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:13.331876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:13.351521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45e57-c5fb-4bc9-a361-da0740e70533 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.351815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45e57-c5fb-4bc9-a361-da0740e70533 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.352068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab45e57-c5fb-4bc9-a361-da0740e70533 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.353693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 233/459] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:13.360014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860fc8a-c3d3-4b43-b38a-8fcb23429f9d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.360295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860fc8a-c3d3-4b43-b38a-8fcb23429f9d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.360564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860fc8a-c3d3-4b43-b38a-8fcb23429f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.399563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3860fc8a-c3d3-4b43-b38a-8fcb23429f9d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:13.400672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3860fc8a-c3d3-4b43-b38a-8fcb23429f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:13.453253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 227/460] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:13.454866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:13.545932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 234/461] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:13.602898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfd53f-cf1d-47dd-8ee3-650f6144d2e9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:13.633362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:13.644255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:13.646504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.646807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.647082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.657848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c13c-9077-48f2-9652-d74d29e9cf2d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.658246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c13c-9077-48f2-9652-d74d29e9cf2d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.658977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c13c-9077-48f2-9652-d74d29e9cf2d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.659632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:13.660608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 235/462] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:13.661966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:13.665942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.666225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.666498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:13.684411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:13.685357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:13.686581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:13.686581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:13.686581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:13.695864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 228/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:13.701881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:13.703060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:13.706260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:13.793308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:13.801337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 236/464] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:13.802390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:13.819967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e81ed-dfe8-4bb7-8c2f-067bb169a6bf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:13.855473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:13.856213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.856721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.857106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.858187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:13.858595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:13.860054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:13.875819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 229/465] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:13.880922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:13.923863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2eb8e-f9d5-43d1-9f8e-b4f7661b4d03 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:13.934734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:13.961051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:13.962047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:13.962537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:13.963024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:13.973903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:13.975603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:13.991025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cdb7-fd7e-49f7-bcf4-f005502ea1f8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:13.991550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:13.992735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:13.993597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:13.993597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:13.993597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:13.995622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 237/466] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:13.996570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.031556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.032240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.032544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.032825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.043340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.044807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.050216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:14.060746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:14.061859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:14.063338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:14.063338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:14.063338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:14.063338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 230/467] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:14.063338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.107043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ebed6-073f-4a6b-ac6b-21c2c5d8811e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.142176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.142871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.143216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.143489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.144128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.145613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.163415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.168209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 238/468] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:13 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:14.169011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.175554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300e2ad-d49b-4cfc-bec7-254a13eb116c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.217834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.218479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.218757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.219026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.219864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:14.220174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.221798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.239815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 231/469] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:14.241322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.323321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c8ef-c90c-4b91-be24-6db25c957f73 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.332660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.373130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.373830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.374111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.374383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.375033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:14.375337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.376736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.387073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1a5-a96d-49a8-a922-7fe65e18358e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.400074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 239/470] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:14.401471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.430470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.431033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.431311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.431583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.446672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.448131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:14.462908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:14.463877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:14.464726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:14.464726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:14.464726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:14.464726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 232/471] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:14.464948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.476735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.516427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b417-3c44-4376-b769-a1393613ebc1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.554539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.555171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.555432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.555705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.556353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.557837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e32a59-16da-429b-8451-eacb6b922294 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.577027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25771ca9-7f95-4343-ae47-5b78fc51ce9c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.579395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 240/472] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:14 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:14.580613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d78a-b241-4f9a-90d5-1ebf1ae9184b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.580898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d78a-b241-4f9a-90d5-1ebf1ae9184b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.581171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d78a-b241-4f9a-90d5-1ebf1ae9184b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.585281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 241/473] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:14.585281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d78a-b241-4f9a-90d5-1ebf1ae9184b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.619821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.647030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.648400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.648763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.649117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.649910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.652449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f39e0-7bdc-4951-b221-cfea4acaef0e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.693342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 233/474] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:14 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:14.693342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.693342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.693342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.714706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:14.716519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:14.765023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d78a-b241-4f9a-90d5-1ebf1ae9184b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:14.818414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:14.822391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:14.823255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:14.824747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:14.825183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:14.826066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:14.826582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:14.828089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 234/475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:14.828438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:14.846713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 242/476] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:14.855231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:14.967396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2625c2-f33f-4b13-8e26-978e3f33465d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:15.006991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:15.007601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:15.007878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:15.008147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:15.008809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:15.010283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:15.034410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 235/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:14 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:15.137316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:15.239313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:15.259245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176768e2-aa81-4cf6-9c65-d8825cb58a0b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:15.293407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:15.294018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:15.294301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:15.294574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:15.295245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:15.297158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:15.311301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 13:58:15.311301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 05 13:58:15.311301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [parameters: {'id': '87f3dd117e6a4722b5e1b3a11b3464b8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 05 13:58:15.311301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 05 13:58:15.328634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return ref.to_dict() Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:58:15.329616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 13:58:15.330986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 13:58:15.332076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:58:15.332957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:58:15.333817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'id': '87f3dd117e6a4722b5e1b3a11b3464b8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:15.334602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 05 13:58:15.337320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:15.339343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 243/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 13:58:15 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:15.339490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:15.398957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:15.454384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb1608-be24-43aa-91a6-9306c512d1ac None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:15.497164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:15.497774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:15.498049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:15.498320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:15.509058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3b32cda4-48c1-451d-9c51-a15696ed9bfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:15.515216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:15.517354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:15.519331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 236/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:15.526059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:15.650396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176f34-b6a7-408d-aab8-cd7a74dbf3fd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:15.697026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:15.697666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:15.697947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:15.698219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:15.698891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:15.699195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:15.700572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a48fda-4245-4e0b-bd74-6807229d7e7a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:15.709450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 244/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:16.889080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fcc62-5970-4f63-8287-caa54f68a70e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:16.889819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fcc62-5970-4f63-8287-caa54f68a70e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:16.889819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fcc62-5970-4f63-8287-caa54f68a70e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:16.891140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 237/481] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:16.906672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1ccc-367c-4522-9f83-87737bf20b81 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:16.907222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1ccc-367c-4522-9f83-87737bf20b81 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:16.907222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc1ccc-367c-4522-9f83-87737bf20b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:16.934326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dcdc1ccc-367c-4522-9f83-87737bf20b81 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:16.935537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dcdc1ccc-367c-4522-9f83-87737bf20b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:16.937817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:17.030558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 245/482] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:17.337430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5849d-9e44-4b54-9124-7debb37c9291 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.338111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5849d-9e44-4b54-9124-7debb37c9291 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.338620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5849d-9e44-4b54-9124-7debb37c9291 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.340421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 238/483] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:17.345994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ee2-ec81-4c5c-9077-5ef14eae3124 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.346282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ee2-ec81-4c5c-9077-5ef14eae3124 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.346560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ee2-ec81-4c5c-9077-5ef14eae3124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.361546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5849d-9e44-4b54-9124-7debb37c9291 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:17.383747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-72748ee2-ec81-4c5c-9077-5ef14eae3124 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:17.384927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-72748ee2-ec81-4c5c-9077-5ef14eae3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:17.529882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 246/484] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:17.547896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea47e60-7a52-4e28-b9b9-53ec75046f83 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.548198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea47e60-7a52-4e28-b9b9-53ec75046f83 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.548448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea47e60-7a52-4e28-b9b9-53ec75046f83 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.550155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 247/485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:17.558543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.558951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.559329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.559643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5849d-9e44-4b54-9124-7debb37c9291 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:17.580817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:17.586773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:17.588031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:17.630800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:17.631422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.631697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.631967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.653754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:17.660130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:17.661867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:17.662666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:17.663680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 239/486] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:17.674236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:17.697403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:17.704897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 248/487] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:17.830238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3c0a-745d-42d4-9868-67d2990cc532 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:17.851197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:17.865979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:17.866580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:17.866858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:17.867128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:17.867788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:17.868495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:17.869909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:17.878212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 240/488] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:17.888493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:17.921612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:17.996291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce439d0-0148-4e8d-9101-3512d274c8e9 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.036899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.037866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.038141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.038412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.061957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.063237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:18.081163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.082130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:18.083564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:18.083564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.083564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:18.085834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:18.086942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.088927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbc55a-1699-464d-95c0-48d3b81810a1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.129766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.133950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.134833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.135210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.147401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:18.152164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.153054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:18.153903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 249/490] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:18.154548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.185677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.201798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d4acf-6218-432a-8184-70bd892045b7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.216767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.236074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.236700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.236979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.237337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.247928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fb691301-0bfe-442c-a44d-289ff72d5e61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:18.253029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.253959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:18.255345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 242/491] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:18.258100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a68c5-4941-464e-b46e-5c53e7a8fc41 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.258100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a68c5-4941-464e-b46e-5c53e7a8fc41 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.258100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a68c5-4941-464e-b46e-5c53e7a8fc41 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.261736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 243/492] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:18.262730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a68c5-4941-464e-b46e-5c53e7a8fc41 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.266690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90ed3-4c7e-450e-8aca-8e0a3b7e24d8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.308468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.309112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.309426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.309701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.310364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:18.310670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.312119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.329202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 250/493] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:18.329202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.381248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a68c5-4941-464e-b46e-5c53e7a8fc41 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.415165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.415764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.416040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.416311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.417133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:18.417461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.418833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7db3ce-8926-4a44-a8fc-16842adf6d90 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.427686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 244/494] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:18.428839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729b5e-3b6b-4be5-aa66-bbe153e5cbf4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.429119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729b5e-3b6b-4be5-aa66-bbe153e5cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.429421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729b5e-3b6b-4be5-aa66-bbe153e5cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.440225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a124-64b9-4236-aeb9-e2799a5fcda6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.441986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.447932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-77729b5e-3b6b-4be5-aa66-bbe153e5cbf4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:18.449103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77729b5e-3b6b-4be5-aa66-bbe153e5cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:18.458421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.475217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.475817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.476093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.476363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.477019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:18.477355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.478756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.486365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 251/495] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:18.487126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.514119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 245/496] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:18.518520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91141-d71a-4681-9afd-bf40b605ffcc None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.518805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91141-d71a-4681-9afd-bf40b605ffcc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.519074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91141-d71a-4681-9afd-bf40b605ffcc None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.521027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 246/497] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:18.522039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b91141-d71a-4681-9afd-bf40b605ffcc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.600676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad7e64-dc33-4466-898a-bccd97375317 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.629827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b91141-d71a-4681-9afd-bf40b605ffcc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.635572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.636173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.636456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.636733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.645594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.647047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:18.661399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.662330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:18.663257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:18.665491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.666109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.666383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.666653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.667131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 252/498] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:18.668018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.670074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.680364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.682167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-10045924-f538-4fb2-87eb-f37865a46785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:18.697723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.698604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:18.699443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:18.699443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.699443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:18.699443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 247/499] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:18.700454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.700454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.700609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.718150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.718704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:18.720077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:18.781546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e4bc9-6638-4d29-87b9-901767b163a0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.798856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 248/500] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:18.799698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.818220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.818862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.819146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.819413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.830701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.832211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:18.846632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:18.847541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:18.848428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:18.848428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:18.848428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:18.852415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 253/501] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:18.853009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:18.914453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc73c-fe75-4d49-aab0-52efe947533b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.934178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.947736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:18.953554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.954309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.954653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.954935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.955663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:18.955969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.957469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.957946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d09e-b967-4993-b6a1-3bf385405d8d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:18.991736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:18.992342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:18.992623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:18.992902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:18.993573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:18.993880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:18.995261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:18.997930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 249/502] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:18.998964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.007766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 254/503] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:19.008661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.109094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018b7f-ff4a-420e-bc6d-f24ed9e86e55 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.110626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103d31-597c-4a4b-a829-ecf50cb77f78 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.142887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.143507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.143608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.143798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.144047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.144275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.144564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.144869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.145542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:19.145858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.147278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.154160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:19.157971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 255/504] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:19.158745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:19.158865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.159707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:19.161049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 250/505] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.161737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.179755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.196243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.261733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf350cda-2110-4917-beb8-a817aa92d707 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.264122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d34b3-f759-47a2-bfc6-754da1884d32 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.294606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.295219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.295495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.295611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.295765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.296096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.296377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.296667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.303192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.304635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:19.317697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.318780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 251/506] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.319695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.365643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.367108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.380430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.410644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.416912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51866c5e-5861-435e-bff4-448b62b491e5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.451576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.452131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.452407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.452676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.463870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 256/507] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:19.464019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.464951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.465489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:19.479466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.480556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:19.481456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:19.481456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.481456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:19.481456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 252/508] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.481456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.566369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f10e1-ee42-4952-a11f-772bf5bdcef9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.578811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c226f4-2121-459c-b3fe-b6906304212e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.579388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.600766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.601419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.601695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.602107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.608696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.610183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.611998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.612596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.612881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.613155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.614465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:19.614769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.616361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:19.622286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.623317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 257/509] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.624393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.627240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 253/510] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:19.628829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.641020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.720826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b80a3-cd6b-420d-9f62-cac780dae2f7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.727703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3aa77-57d6-42dd-807e-be389b409fa2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.757610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.758217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.758499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.758773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.759493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:19.759802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.760967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.761258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.761620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.761906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.762183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.773588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.775024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:19.789626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.790692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:19.791520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:19.791520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.791520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:19.791520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.791520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.797799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:19.798621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.827801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.858180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:19.896389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50045c1-1773-4090-bcff-7bb22eee7327 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.896540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea3-a98b-43c9-9825-68679a6f07a3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:19.929289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.929847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:19.929979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.930154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.930434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.930518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:19.930746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:19.931025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:19.931121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:19.931358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.932728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.941898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:19.943500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:19.948792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:19.948792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:19.963266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:19.964186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:19.965013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:19.965013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:19.965013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:19.965013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:19.965251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.044451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594392b-19c3-4958-a298-0a4e40b8e8e3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.047282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.065931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3d07e-f8ca-4b01-819d-27fffa032f5e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.066401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.077941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.078609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.078894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.079170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.079896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:20.080207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.081685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.099234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:20.100279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.105218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.105853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.106137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.106413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.107051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:20.107355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.108737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.120089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 260/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:20.120853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.201577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181503d-447f-47bc-90f1-604d502b1c0d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.218807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a218d-126c-494b-880c-8cdb201e0279 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.233457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.234049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.234327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.234600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.251543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.252142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.252425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.252705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.253373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.255373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.272005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.282656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.285664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 261/517] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:20 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:20.286718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.306417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.307951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.398600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a21-eafe-45ab-8bd7-e1c0ba219966 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.430127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 257/518] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:20.431234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.443461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.444079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.444366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.444695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.445385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:20.445696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.447135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.459532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:20.460358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.529031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.532387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.552025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fd6b4-5cab-4c21-878d-261693e847ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.576482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429a72-8152-4820-811b-1fa33c73edb3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.589675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.590779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.591067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.591621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.611203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.611831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.612109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.612379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.620030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.621525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:20.633240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:20.634097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:20.634943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 263/520] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:20.636313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.663386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.665506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.744031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d129b1-ad9b-41a5-9dd8-1fe815a1331c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.749882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.763954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.775403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 258/521] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:20.777091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.789186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.789855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.790139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.790407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.803063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.804541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:20.819630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:20.820517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:20.821366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:20.821366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:20.821366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:20.821366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 264/522] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:20.821917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.883970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b955cf9-67b9-4610-a16c-ea05b014ee9c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.919347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.919971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.920246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.920520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.928277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.929767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.932117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ac85-acbf-4c98-942a-31c574f26183 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:20.942222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:20.943119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:20.944023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 259/523] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:20.944593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:20.972698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:20.973909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:20.974211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:20.974452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:20.975136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:20.975438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:20.976868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:20.989573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:20.999255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 265/524] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:20.999255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.030476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.060855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16983-7615-4e40-a38a-c451137051fc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.098302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.098927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.099333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.099607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.102675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0d698-5c16-4868-b3fc-4d509dcf67e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.110864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.112427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:21.129616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:21.130513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:21.131353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:21.131353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:21.131353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:21.131353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 260/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:21.131974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.140951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.141559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.141840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.142117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.142759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:21.143064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.144435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.156285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 266/526] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:21.157073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.234310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.244270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4205-950d-4a37-8d2c-7a0398997ced None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.253588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.264359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d68c9-9a79-4b0f-b621-94e814c03fc6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.282586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.283184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.283461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.283733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.284819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:21.284819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.286209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.299151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.299746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.300021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.300289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.301036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:21.301371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.302790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.309085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 261/527] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:21.309085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.309317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 267/528] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:21.309317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.428836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1115e-6774-458d-ac29-31e90710b017 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.452014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805c779-b2a4-4766-b029-825a3fb53f99 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.471309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.472278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.472827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.473314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.474152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:21.474553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.476048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.493812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 262/529] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:21.494314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.500930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.502807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.502807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.502807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.509367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.514166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.516022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:21.527873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:21.528738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:21.529704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 268/530] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:21.530172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.546763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.612950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2b4d-64ac-423e-ac45-22cff2781ba4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.635223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad234b-d276-4372-a764-0d10cf360daf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.658605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.659223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.659507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.659784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.673613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.674635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.675109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.675643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.683980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.685819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:21.699074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:21.699919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:21.700804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:21.703248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 269/531] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:21.704275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.745257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.746748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.761282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.805677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:21.838503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf7482-6864-4e6d-878f-2bf7de295839 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:21.865182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 263/532] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:21.866648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.886641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:21.887259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:21.887542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:21.887817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:21.888518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:21.888827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:21.890307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:21.907528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 270/533] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:21.908479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:21.993961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68096a7-dc38-4e12-a737-64b06a9803dc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.014693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:22.025572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2729a-15b3-4c31-8360-8ab07b26995a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.043693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.044448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.044803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.045150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.045962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:22.046339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.047914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.071084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.071724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.072005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.072278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.073343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 264/534] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:22.074239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:22.074375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.087398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.089884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:22.111278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:22.112424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:22.114030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:22.114030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:22.114030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:22.119904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 271/535] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:22.120816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.200073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d31452-c474-4320-8254-00b8b0b8c73d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.226107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3079-4443-48c1-9189-4b210d595075 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.242550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.243331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.243719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.244159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.244973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=35ef931ea9f54d2b85df3bb3f6158b81) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:22.245454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.247365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.260692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 265/536] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/role_assignments?user.id=35ef931ea9f54d2b85df3bb3f6158b81&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:22.261933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.272891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.273892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.274318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.274734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.275611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=1a782cf2bac541d9b83a99b77fafb9bf) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:22.276081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.278346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84928208-bcb1-41d3-b74c-64460a0f1770 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.286319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 272/537] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/role_assignments?user.id=1a782cf2bac541d9b83a99b77fafb9bf&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:22.338359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:22.439061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b033e4-9f12-4020-abf3-2e60a0f8713f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.496074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.496074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.496074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.496402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.496993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:22.497324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.498728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.503223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcbe9-8c04-416f-9d50-2a6138d4646f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.503517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcbe9-8c04-416f-9d50-2a6138d4646f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.503788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcbe9-8c04-416f-9d50-2a6138d4646f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.505382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 273/538] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:22.511836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.512127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.512827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.516579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 266/539] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:22.522947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.540719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:22.542328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:22.607825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:22.645259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 274/540] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:22.673173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d24bd-aabc-41a1-a7cd-a88491accc60 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.689577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:22.708476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.709164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.709475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.709753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.716699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.718327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:22.731782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:22.732644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:22.733515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 267/541] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:22.742345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.894190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fbb5c-aba9-4f67-9eac-1fa8484d252f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:22.949673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:22.952783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:22.953444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:22.953729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:22.954006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:22.954833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:22.955143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:22.956590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:22.978867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 275/542] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:22.984959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:23.062437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:23.104856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394045-b896-4569-9777-9fb41db7bd60 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:23.171744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e13a-adb3-4c68-b11b-8b6e2595f17c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:23.174958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:23.175602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.175921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.176197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.197520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:23.203184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:23.204066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:23.204844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:23.206917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 268/543] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:23.218379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:23.225714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:23.226337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.226857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.226857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.227607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=33c4e0b235524e84b0d003e7dfdb00fd) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:23.227915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:23.229394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:23.235897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 276/544] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:22 2022] GET /identity/v3/role_assignments?user.id=33c4e0b235524e84b0d003e7dfdb00fd&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:23.258717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:23.408776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449471b-e04e-488b-8aaa-8eac9cf9bc59 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:23.455004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:23.455613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.455889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.456161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.456819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:23.457150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:23.458545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:23.468213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 269/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:23.474355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:23.595126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c990d8-5466-4998-bd52-f0c87e6b93b6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:23.597564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:23.631187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:23.631829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.632110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.632385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.643371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:23.644896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-08e6be49-18b9-4f8f-9044-3a506b967869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:23.661749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:23.662683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:23.663761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:23.663761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:23.663761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:23.663761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 277/546] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:23.674445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:23.779822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:23.806002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229aed-a532-42f3-a627-6d1b71c0a6e8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:23.806905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e7cb-7843-4d24-b1ff-a566eefbb1b8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.807192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e7cb-7843-4d24-b1ff-a566eefbb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.807492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751e7cb-7843-4d24-b1ff-a566eefbb1b8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.808946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 278/547] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:23.818422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.818919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.819214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.849395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:23.850582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:23.859709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:23.860319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:23.860595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:23.860867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:23.861530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:23.861828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:23.863181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:23.885408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 270/548] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:23.892254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:23.983707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 279/549] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:24.024845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52353f6-3d69-4aaa-8ddb-8f1f9c301c06 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:24.069341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:24.069983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:24.070262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:24.070534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:24.077604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:24.086533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:24.088380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:24.103699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:24.105956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:24.107051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 271/550] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:24.110648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.236680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:24.259489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0835d-eb48-4438-b37a-4b4742003f28 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:24.297448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.311083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:24.312070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:24.312655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:24.313127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:24.314107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:24.314607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:24.317092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:24.341949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:24.357733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.430417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0e82-a6d8-40b9-98ec-a15d6149597d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:24.469096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:24.469746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:24.470021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:24.470292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:24.487366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:24.493623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:24.494705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:24.495523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:24.498819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:24.506133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.523774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793048a-9dff-4548-b2b0-b5a98b0d89da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:24.591483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:24.592377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:24.592965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:24.594683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:24.616484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:24.628180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:24.701960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d338e6e-2468-41a2-b4de-e9342696a03b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:24.735100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:24.741279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:24.767405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:24.769061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:24.769551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:24.770018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:24.771683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:24.772141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:24.773698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:24.792034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 273/553] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:24.796073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.925288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 281/554] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 13:58:24.933175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:24.989660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a168bf-244c-440e-8451-afdeb2121502 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.021550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.024765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.049384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.050953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.051738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.052215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.067401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.069709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.086681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ba57-b1e5-4092-a81c-14bbc91d229b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-150b91db-3ef1-45b4-9b50-b85f64afc513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:25.089584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:25.090662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:25.091749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:25.091749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:25.091749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:25.094479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 274/555] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:25.096611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aceaca-579c-4c7c-9360-62d1f8f47db4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.096902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aceaca-579c-4c7c-9360-62d1f8f47db4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.097181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aceaca-579c-4c7c-9360-62d1f8f47db4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.098677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 275/556] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:25.103182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aceaca-579c-4c7c-9360-62d1f8f47db4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.132528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.133166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.133478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.133754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.147040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.148636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6e6777ae-fda9-4b37-9ea8-89df90f76a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:25.165083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:25.166683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:25.167561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:25.167561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:25.167561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:25.171093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 282/557] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:25.172600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.172890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.173169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.196181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:25.197456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:25.236569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aceaca-579c-4c7c-9360-62d1f8f47db4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.269983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 283/558] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:25.270968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.275250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.276092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.276565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.277049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.277977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:25.278495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.280041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.293424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 276/559] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:25.299227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.303162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.332322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.398841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18599b-f415-4644-a102-0a8af09ad87a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.407350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dd56-86c7-4873-8421-be1bcc72febc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.444224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.445178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.445780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.446213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.446472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.446885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.447173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.447448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.448273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:25.448583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.450899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dba5b-fb65-4a13-b2d6-c31cc201d014 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.455245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.456929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-091506b2-0718-4ac9-9da6-df9afef60566 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:25.469073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:25.470064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:25.471014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:25.471535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 284/560] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:25.471535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753f03-5f32-40cf-953f-304b9e6111a4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.471535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753f03-5f32-40cf-953f-304b9e6111a4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.471535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753f03-5f32-40cf-953f-304b9e6111a4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.473344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 285/561] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:25.473938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 277/562] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:25.478478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753f03-5f32-40cf-953f-304b9e6111a4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.480040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.480477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.480891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.500950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:25.502370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:25.574719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 278/563] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:25.575819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.599576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.604876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.630222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753f03-5f32-40cf-953f-304b9e6111a4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.677941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.678581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.679179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.679470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.684711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6b738-12bd-414d-a975-dafa54a6a10c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.686294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.687757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:25.699123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:25.699996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:25.700885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:25.704879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 286/564] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:25.705638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.720504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.721109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.721415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.721688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.722466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:25.723297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.724716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af97dd-fe3d-456a-83ec-8f521c480f81 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 279/565] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f914d-527e-49af-94b3-8e673025f639 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f914d-527e-49af-94b3-8e673025f639 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f914d-527e-49af-94b3-8e673025f639 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 280/566] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:25.747268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f914d-527e-49af-94b3-8e673025f639 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.826425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d7a-e09f-4bbf-8b6f-f6bc9d9828a5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.838214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.862891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f914d-527e-49af-94b3-8e673025f639 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:25.863078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.864240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.864519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.864791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.874880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:25.880097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:25.881026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:25.881903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 287/567] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:25.882653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:25.890265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:25.901926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:25.902527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.902808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.903082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.903770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:25.904090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:25.905543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cafbd-4999-43ee-866d-442a5af82ee4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:25.917410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 281/568] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:25.918550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:25.918835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:25.919107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:25.936594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:25.937799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:25.985368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1b8a6-3b2f-49ac-a542-51892b35b760 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.002720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 282/569] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:26.003551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.028636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.029297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.029581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.029842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.041753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.043208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:26.056814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.058033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:26.059255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:26.059255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.059255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:26.059255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 288/570] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.059255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.075933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.110570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45e09-439a-433a-9320-3a7406a176a7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.126994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.148092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.148844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.149125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.149430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.162256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:26.168559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.169698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:26.170524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 283/571] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.171213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9ae85-c29c-4d43-b087-d178ea796c60 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.171286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.205893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.206631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.206914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.207755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.208421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:26.208779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.210215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.218109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 289/572] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:26.218891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.287803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad686de-5901-4058-b330-d836016a7111 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.313574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.319693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72801-0104-424d-b0a1-6e41c0c3a639 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.322034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.322702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.322985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.323258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.323979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=79c09cbdb8dd45f49e430fbf5fe59e25) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:26.324289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.325761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.331084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 284/573] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/role_assignments?user.id=79c09cbdb8dd45f49e430fbf5fe59e25&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:26.331694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.354190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.371067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.371637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.371916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.372186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.372847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:26.373149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.374596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.388427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 290/574] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:26.389321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.451080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c065f-8057-4f25-9684-0462ff4661f7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.489385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.490010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.490543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.490819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.491498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:26.491806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.493187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.501688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 285/575] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:26.502510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.509047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81604-b4bf-4cfc-95a2-43ac2402e177 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.553403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.554051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.554469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.554763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.560913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.565513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.567009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:26.581628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.582637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:26.588898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:26.588898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.588898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:26.588898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 291/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.588898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.616426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25991d-ec6e-442e-87fa-d822a93c1c0f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.617842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.653671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.654218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.654503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.654774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.666206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:26.672144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.673081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:26.673983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 286/577] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.675356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.696496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0926c-3244-4bf3-9fe5-36cee981ed20 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.731637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.732263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.732550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.732826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.740497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.742036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:26.753165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.754669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:26.755539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 292/578] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.756608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.791424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f88a-98b6-4eb6-94de-52a1b67adf69 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.808235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.833103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.833875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.834157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.834433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.845894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.847386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.854889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:26.864321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2d444-6a5e-4001-9d19-ab812af3aa95 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:26.864557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:26.866005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:26.866904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:26.866904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:26.866904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:26.866904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 287/579] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:26.866904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.902287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:26.902893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:26.903174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:26.903669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:26.904130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:26.904391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:26.905786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:26.917780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 293/580] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:26.917780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:26.979706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebc0c0-dc09-4bff-a2e0-a74014626ec2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.016196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.016791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.017067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.017366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.018139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.018551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.019938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.021320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3470-b096-4779-9d8f-c58715e9e94f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.032746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 288/581] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.032746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.059636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.060238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.060515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.060788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.061044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.061874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.062189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.063775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.075723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 294/582] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.076528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.094886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.143665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5f22b-4fec-4ae2-9275-364527e3675d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.179574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.180125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.180462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.180869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.181608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.181911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.183336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328848-809c-4dea-be94-3960d5d37f01 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.183535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.202219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 289/583] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.202219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.225620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.226336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.226685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.226964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.234315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.235754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:27.247504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:27.248437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 295/584] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:27.249446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.291366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.305977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9ad9e-3b3d-4278-b01a-8f1ecdd8f0cb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.323204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.341006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.341652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.341929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.342199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.352892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.354325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee63b8-c8a5-476c-901f-e545603a4160 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.354436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:27.370436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:27.371390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:27.372871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:27.372871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:27.372871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:27.372871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 290/585] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:27.372871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.393115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.393801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.394085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.394363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.409363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=0984655bd84440f0b4baf516e7be88b9, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.411355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.428688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 296/586] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:27 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:27.429645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.504071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b126-5914-4264-aa27-31e28f6b35b8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.542415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.543050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.543324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.543595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.551961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.553476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.556511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:27.566741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:27.567776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:27.568732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:27.570706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ed03-2018-412b-979f-da537ab8e59e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.578444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 291/587] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:27.578444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.612547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.631888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.632869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.633397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.633830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.634569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.634877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.636327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.657671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 297/588] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.658821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.699776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f616fb-080a-4d3c-a56b-f86bb3c80ebb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.737458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.738170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.739010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.739281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.739963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.740513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.741933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.765253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 292/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.765253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.791214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f29e-103d-4d26-821d-4cff67f45e06 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.828668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.829405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.829784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.830145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.830900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:27.831205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.832673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.837947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.853757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 298/590] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:27.854927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:27.892102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543696-ecb1-426f-97b3-b07a1df7acfd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.899353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:27.940353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:27.941814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:27.942269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:27.942703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:27.955959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:27.958119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:27.968094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e460ea-981c-4005-ac06-e6348bd8b283 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:27.977001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:27.978195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:27.979286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:27.979286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:27.979286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:27.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 293/591] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:27.984382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.013941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.014728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.015102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.015474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.023029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.024595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:28.038173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:28.039358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:28.040534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:28.046547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 299/592] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:28.047483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.118198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934487a6-62f1-42e3-b29d-673a3ca6f96b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.131260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.153942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.154177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.155273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.155811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.156039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.158765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bf619-31f8-43c1-8f9e-4d008c4bd7d5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.168208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.169825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:28.184647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:28.185826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:28.186925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:28.186925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:28.186925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:28.188227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 294/593] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:28.189153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.199438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.200247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.200693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.201106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.201909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:28.202403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.203943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.218170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 300/594] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:28.219309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.304656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de5c9-c126-4d22-8adf-bf6aa5b7b708 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.333735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0f79-ec9c-4721-b54d-3da3271d2172 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.351858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.353042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.353500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.353910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.354787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:28.355232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.357754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.371951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.372752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.373934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.373934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.374322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:28.374742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.376271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.387866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 295/595] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:28.389131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.395315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 301/596] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:28.396420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.416628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.423109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.507222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8569d99-9af2-4825-b8a2-33fcb1883778 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.530304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d89dac-40c5-4788-901d-ec491826058e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.546334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.547182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.547637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.548071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.559323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.560920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.566017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.567171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.567448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.567721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.574638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.576059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:28.576884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:28.577987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:28.579010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:28.579010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:28.579010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:28.580500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 302/597] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:28.581578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6af35c6b-9594-4aea-a90c-e24e2a5f2833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:28.590903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:28.591793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:28.592699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 296/598] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:28.593673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26655a1-52f0-41d1-84a2-d1a0b050f63c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.593840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26655a1-52f0-41d1-84a2-d1a0b050f63c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.594120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26655a1-52f0-41d1-84a2-d1a0b050f63c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.599710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 297/599] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:28.599710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26655a1-52f0-41d1-84a2-d1a0b050f63c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.669044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.685246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.701327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eff337-b73b-4c66-b6d0-af644ce8bb83 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.704672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26655a1-52f0-41d1-84a2-d1a0b050f63c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.736620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.737274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.737551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.737828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.742555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.743444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.743864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.744323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.745095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:28.745249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.745734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.746627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.747500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-994838c5-1ac9-491b-9854-5fea737a7f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:28.757999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:28.759060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:28.760165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:28.762423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 298/600] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:28.763372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.763940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 303/601] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:28.765143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.765472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.765751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.790572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:28.791753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:28.861126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 304/602] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:28.862220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.897499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402213-8bdf-429b-8c0d-b00fba545f39 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:28.934006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.935022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:28.935865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:28.936510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:28.937345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:28.938640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:28.939024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:28.940526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:28.956704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 299/603] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:28.958165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:28.961630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:28.988223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cc14-19f3-4805-b5f1-b45b07b1d9c0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.026256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.026793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.027074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.027354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.028047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:29.028353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.030104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.047766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 305/604] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:29.047766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.085514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435f7e-a0c0-4992-80d3-9530d8bf4d3f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.129199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.130226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.130754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.131242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.139731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.141528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.150052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f61391-cc0f-4cd6-9d13-b51b85653f89 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:29.156047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:29.157009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:29.157986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:29.158436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 300/605] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:29.159359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.173844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:29.189282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.189960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.190242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.190520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/35ef931ea9f54d2b85df3bb3f6158b81/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.205025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=35ef931ea9f54d2b85df3bb3f6158b81, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.206512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.222540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 306/606] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:29 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/35ef931ea9f54d2b85df3bb3f6158b81/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:29.224483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.230658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:29.277300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead18315-0042-42ac-8dc4-c7c25bc97861 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.327291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.328088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.328334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.328620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/1a782cf2bac541d9b83a99b77fafb9bf/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.347459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=1a782cf2bac541d9b83a99b77fafb9bf, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.349119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.366673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 301/607] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:29 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/1a782cf2bac541d9b83a99b77fafb9bf/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:29.367524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.375943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54233455-4735-47d4-b2ef-6d133c41dc2d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.432695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.433760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.434276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.434758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.453640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:29.459821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:29.460923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:29.462095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:29.464436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 307/608] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:29.474658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.535463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:29.552770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bed69-facc-4181-94bf-a64fec8bae4d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.585886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:29.640583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.640805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.641546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.641546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.645258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:29.645258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.645258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.657927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedebb2-a0c6-450d-b317-e41335e6e6db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.662476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 302/609] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:29.668602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.695967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.696825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.697316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.697713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.698580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:29.698987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.700478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.711166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 308/610] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:29.718551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.846759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:29.863832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99322e-7708-45c6-a988-68fd4e88ac0e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.871061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1e3b6-19f1-4d7a-a405-d7f45b89f28e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:29.914203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.914944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.915224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.915417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:29.915548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.916068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.916395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.916670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/33c4e0b235524e84b0d003e7dfdb00fd/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.930074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.931550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.936500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=33c4e0b235524e84b0d003e7dfdb00fd, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:29.937961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee705c-9f13-4a02-bee8-91befb7af74d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:29.951671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:29.953001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:29.954124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:29.954124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:29.954124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:29.960610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 303/611] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:29 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/33c4e0b235524e84b0d003e7dfdb00fd/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:29.960610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02104-5525-4a63-bd2b-d24f83ba823b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.960610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02104-5525-4a63-bd2b-d24f83ba823b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.960610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02104-5525-4a63-bd2b-d24f83ba823b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:29.961341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 309/612] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:29.962413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:29.965947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 304/613] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:29.982035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:29.982319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:29.982597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.020745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:30.022297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:30.058257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.091218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f96f3-f1f9-4189-85da-56017435c748 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.132751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.133783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.134207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.134705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.135560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:30.136018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.137624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.152846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 310/614] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:30.158259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.168407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 305/615] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:30.168742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.297813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28738-638e-4d4e-a064-5b2337552490 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.334275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.334836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.335117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.335392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.343097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.344550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:30.360540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:30.361560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:30.364037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 311/616] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:30.368273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.495057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092c15e-b22d-404e-997c-0601431bba2e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.499115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.537130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.537776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.538879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.539159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.539904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:30.540208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.541681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.563955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 306/617] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:30.569130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.569805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.582686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.614546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fede9-bec4-4e84-8c0b-3f280856565a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.652244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.653340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.653883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.654363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.666437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:30.671287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccda32-3faf-4914-918f-467252740b0c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:30.672349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:30.673286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:30.674218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:30.676926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 312/618] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:30.683095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.707438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.708075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.708353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.708624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.719236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.720680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:30.738714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:30.739875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:30.742732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:30.742732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:30.742732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:30.742732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 307/619] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:30.745869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.808583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.815991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701799f3-b6bd-40ce-85ca-fd51cb8fe526 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.842954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:30.855677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.856633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.856760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec456c-feb7-42ad-9d4f-d3f48d4f0264 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:30.857311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.857857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.858718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:30.859226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.860809 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.870391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 313/620] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:30.876275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:30.926704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:30.927314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:30.927597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:30.927869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:30.928511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:30.928816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:30.930213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:30.959002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 308/621] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:30.964941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.075930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77dce-9e7e-4b2e-aa33-b2efbf4a2392 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.093366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aed02-6885-4e46-a73c-7020978e2395 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.122020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.123084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.123590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.124071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.137142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.138920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.143827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:31.155608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:31.156565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:31.157601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:31.157601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:31.157601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:31.158992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 314/622] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:31.164161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.177380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.178734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.179439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.180135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.193295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.195865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:31.219353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:31.220303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:31.221265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:31.227728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 309/623] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:31.233544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.251542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:31.334718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d7a4-abbe-4069-aace-eedf7d0cdbd7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.370948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.371843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.372334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.372756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.373581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:31.374059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.375661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.389744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 315/624] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:31.396209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.427280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27d0e-2d1c-4309-8885-daf61bd8aee1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.467809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.468704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.469134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.469576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.470421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:31.470881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.472463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.496590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 310/625] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:31.512160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.596537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:31.602279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:31.611162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb5bc-c342-4323-8d1b-045f55f8edfd None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.674383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.675135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.675523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.676460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.692059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.693710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.700170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991d34a-93f3-41c4-8050-98092ea5794a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:31.715827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:31.717002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:31.718272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:31.725410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 316/626] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:31.731139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.776879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.777740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.778126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.778510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/79c09cbdb8dd45f49e430fbf5fe59e25/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.814882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=79c09cbdb8dd45f49e430fbf5fe59e25, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.816945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418e47-3ada-4252-9a27-23584991c8d5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.855744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 311/627] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:31 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/79c09cbdb8dd45f49e430fbf5fe59e25/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:31.893641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f72514-6350-47d0-a2bf-f8a7710b909a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:31.932617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:31.937002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.937002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.937002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.937002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:31.937457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442096cd-7b99-4c3f-bc02-38f71e8f8d98 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.937547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:31.937639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442096cd-7b99-4c3f-bc02-38f71e8f8d98 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.937639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442096cd-7b99-4c3f-bc02-38f71e8f8d98 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.937787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fde92-1dd1-4866-a817-1ff7982f8dba None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:31.938116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 312/628] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:31.944332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55e5a9-b0fa-4a0b-a693-e076262edff0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.944826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55e5a9-b0fa-4a0b-a693-e076262edff0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.945273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55e5a9-b0fa-4a0b-a693-e076262edff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.960163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:31.962346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d914-e703-47d8-aa72-ff3a1a4d9ceb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:31.962744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d914-e703-47d8-aa72-ff3a1a4d9ceb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:31.963288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356d914-e703-47d8-aa72-ff3a1a4d9ceb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:31.964941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 318/630] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:31.965819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d914-e703-47d8-aa72-ff3a1a4d9ceb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:31.967913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9d55e5a9-b0fa-4a0b-a693-e076262edff0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:31.969522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9d55e5a9-b0fa-4a0b-a693-e076262edff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:31.990750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.063619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 313/631] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:32.067298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.067778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.068201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.091408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:32.092975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:32.117067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356d914-e703-47d8-aa72-ff3a1a4d9ceb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.129520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.162017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.162681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.162968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.163246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.183156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 314/632] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:32.265544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:32.267013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:32.284471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.368013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.404953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 319/633] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:32.410950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.473818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf198d-fd24-45b3-94f4-9bcbb042713f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.515022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.516041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.516529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.517031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.533134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:32.544812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:32.545822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:32.546640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:32.550349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 315/634] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:32.556481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.572505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.581808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901268c8-b5d0-4d4b-a1af-ce6108884a5a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.600796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.621292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.621934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.622208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.622423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.633783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:32.635248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:32.651702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:32.652676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:32.653596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:32.653596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:32.653596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:32.653596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 320/635] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:32.655134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.668430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f327c-5c98-44b6-b3d0-b5decc5c9bfc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.713139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.714559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.715080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.715566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.730256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:32.736821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:32.738100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:32.738965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:32.742820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 316/636] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:32.743932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.777263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9c53a-20d8-4e34-a0c1-bbc8cae50761 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.814138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.814920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.815311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.815695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.816547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:32.816964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:32.818525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:32.827050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 321/637] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:32.828020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.837478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.861775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:32.866447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e5c3-2238-4eb3-a1ba-0812cd76623f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.901881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.902490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.902773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.903047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.903727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:32.904039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:32.905480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a0a78-7cd4-4903-819b-cb19deab0579 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:32.917771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 317/638] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:32.919968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8650-418e-4ebe-8785-47324531e4b2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.920712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8650-418e-4ebe-8785-47324531e4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.921171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8650-418e-4ebe-8785-47324531e4b2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.923010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 318/639] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:32.924193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8650-418e-4ebe-8785-47324531e4b2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:32.940856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ecfd8-6a01-4b9c-9fd9-ddda3651e31c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:32.976023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:32.976716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:32.977066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:32.977449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:32.978172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:32.978485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:32.979861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:32.988523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 322/640] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:32.989268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.040421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8650-418e-4ebe-8785-47324531e4b2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.072708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.080141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.081056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.081376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.081637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.089145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.096372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.097943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.101778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440dd8-8669-4650-ae52-12fd486812c7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-289a74e1-dc27-4061-bd75-17fe8c43462d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:33.114363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.115647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 319/641] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.121430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.138824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:33.140198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.140449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:33.140825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.141119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.141415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.148719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.150204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:33.161885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.162847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:33.163753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:33.165361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 323/642] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.166719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.213445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 320/643] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:33.214278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.289524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80c2a5-9a08-4027-81d6-eabcc2c5f6de None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.326842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b230-3636-4cb3-a990-5b0ab4027bf6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.338259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.339577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.340324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.340832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.342759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.358045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.360444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.364980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.366005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.366348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.366684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.367441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:33.367803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.369426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:33.379609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.380549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:33.381666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:33.381666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:33.381666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:33.387006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 324/644] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.387006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.388948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 321/645] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:33.390160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.393236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.501902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f6dd-5ab1-4f47-b225-30aef06906b2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.508234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b98-249f-490e-8ec2-d481783eb15b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.542992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.543523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.543805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.543976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.544095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.544555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.544743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:33.544927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.545078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.545167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.545825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:33.546131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.546498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.547473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.559131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 325/646] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:33.565607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 322/647] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:33.565607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.565805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.601633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.630850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.669800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c97e-233f-4fd5-a12b-e6a39cf985eb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.673168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972c7b-6204-439b-a73c-70100e6a05e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.706897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.707666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.708048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.708420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.710597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.711699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.711985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.712259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.715936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.717515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.722978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:33.727773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.728842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 323/648] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.735126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:33.736403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.737587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 326/649] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.739272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.845811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662368-8130-4f28-ae62-9a5f918845c5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.846493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.855810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9fc97-b2bc-4a8d-9632-0791c56be4a0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:33.871006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:33.884418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.885049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.885629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.886009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.893003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:33.893640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:33.893899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:33.894169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:33.895447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:33.895550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.895752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:33.897160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.897270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:33.909521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 324/650] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:33.909521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:33.910014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:33.911090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 13:58:33.912216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:33.918249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 327/651] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:33.918249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.029198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72435-9c9a-4550-adb9-bfac743923c2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.043523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff173-6aac-4eb9-92b8-7ac3bd8fb1f7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.072600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.073559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.074022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.074449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.075558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:34.076467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.078661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.081571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.082874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.083278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.083655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.084501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:34.084911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.086495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.090774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 325/652] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:34.091877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.113396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:34.114739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.122196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.167879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.231576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5f00-eabb-452a-8102-914db553a300 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.245908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c9c02-fbd2-4840-ad1c-3d17bb05a799 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.272987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.273686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.273999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.274270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.275004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:34.275314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.276803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.291010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.291678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.291961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.292235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.298053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 326/654] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:34.298948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.306221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.308986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:34.328609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:34.329618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:34.330496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:34.330496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:34.330496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:34.333590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 329/655] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:34.334166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.395761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.419763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdee6f2-5706-4aa0-b335-478774a1c09d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.448790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.456453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.456691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b973dbe-7faa-4c53-adfd-aff9df250fd9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.457095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.457410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.457690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.493383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.493999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.494281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.494559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.534116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.535594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.566840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.568343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130dd3f-1955-4910-b8c1-669bd9d02782 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.616268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.639782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 327/656] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:34.641316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.663918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 330/657] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0da51-30c5-4014-bbde-445ae2c4ba1d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0da51-30c5-4014-bbde-445ae2c4ba1d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0da51-30c5-4014-bbde-445ae2c4ba1d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 331/658] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:34.677266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0da51-30c5-4014-bbde-445ae2c4ba1d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.761412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dcf55-df87-475d-a87c-fdc2772accea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.780661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0da51-30c5-4014-bbde-445ae2c4ba1d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.805962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.806659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.806935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.807205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.807839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:34.808137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.809524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.817198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.817857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.818139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.818421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.821616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 328/659] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:34.822710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.830225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.831777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-6005764c-0b08-4970-927e-71c913b7774c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:34.849091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:34.850098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 332/660] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.856495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.867316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.875285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:34.876500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:34.919990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:34.935265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6da8-32bb-4688-8085-6367185d29d5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:34.948076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 333/661] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:34.949247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:34.981671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:34.982310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:34.982590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:34.982865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:34.995634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:34.997208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:35.013144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:35.014199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:35.015086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:35.015086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:35.015086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:35.017108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 329/662] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:35.018200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.090866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167ab4-03f9-45c8-9271-0eec3eedbaa1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.119879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.133464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9b97-4e65-4871-bd00-cb9d5e0f20fc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.137293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.137939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.138225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.138507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.147987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.149750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:35.164571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:35.166169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 13:58:35.167103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:35.170365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 334/663] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:35.171482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.179017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.179872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.180351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.180823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.181733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:35.182237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.183818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.196173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 330/664] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:35.197129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.218184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.294556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d5d7-6641-4fe2-8446-ce49bb59daab None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.310274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369afab-defc-4afa-aa2d-121646e1c151 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.330379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.330996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.331281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.331633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.332851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:35.333158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.334580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.346424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 335/665] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:35.348362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.348968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.349271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.349550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.350281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:35.350586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.352012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.352252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.372635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 331/666] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:35.374738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.386697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.449630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.456243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470d595-7ff0-4652-9906-31252256dfa9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.482751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d053a2f-1814-44b6-a0ba-43d3eb7600f4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.492473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.493107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.493470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.493748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.500558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.502052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:35.512977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:35.514030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 336/667] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:35.514954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.522830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.523462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.523736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.524005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.535635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:35.540311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:35.541269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:35.542133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 332/668] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:35.542864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.613777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.625986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3a25-097a-40a1-82c0-6c649c5b3ba6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.650049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895c2a-9d7e-4459-aa81-d2577652526d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.661569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.662207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.662491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.662764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.671201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.673341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:35.688626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:35.689538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:35.690440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:35.690861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.690861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.690861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.690861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.691118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:35.691714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.710665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.762099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.763658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.799732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc67c-f6ae-4a04-a636-4669f25daa0c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.835240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:35.835852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:35.836135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:35.836413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:35.837103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:35.839228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:35.839228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:35.840500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.851972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 338/670] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:35.852589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.885541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 333/671] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:35.885541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:35.940627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:35.965676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be765ed-8ec3-4ad7-a2de-4b106d7781ec None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:35.987543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5fe5-b0d5-45fa-9daf-ab3fafe2b88c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.004209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.005164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.005308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.005572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.006229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.006810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.008189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.021440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 339/672] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.022356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.026230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.026949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.027332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.027710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.028506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.028918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.030495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.048186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 334/673] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.048186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.081046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.131112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3cc81-11f3-4cbb-8d88-5013cf7783b8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.166296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2280-2207-4f75-b9ed-0ce7ef5ec431 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.168146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.168771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.169051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.169358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.170095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=35ef931ea9f54d2b85df3bb3f6158b81) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.170409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.171853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.177549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 340/674] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/role_assignments?user.id=35ef931ea9f54d2b85df3bb3f6158b81&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.178333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.180952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.221955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.223781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.224325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.224808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.239352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.241764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:36.260267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:36.261518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:36.262632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:36.262632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:36.262632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:36.266023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 335/675] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:36.267020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.298715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31bf14-0c92-4582-8c7e-c0c13780e7c4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.337043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.337711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.338003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.338377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.350649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.352125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-96015c98-7120-4856-8c83-f4b5579169d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:36.371609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:36.372664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:36.373583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:36.373583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:36.373583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:36.373583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 341/676] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:36.373911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762408f-68a5-44a8-a6de-1b7b6493ed98 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.374260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762408f-68a5-44a8-a6de-1b7b6493ed98 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.374540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762408f-68a5-44a8-a6de-1b7b6493ed98 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.375761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 342/677] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:36.375994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.376445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762408f-68a5-44a8-a6de-1b7b6493ed98 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.401682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47a7c0-5d24-46e6-9003-cc5ed9f50bd3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.440757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.441541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.441826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.442099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.442939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=1a782cf2bac541d9b83a99b77fafb9bf) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.443247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.444665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.448033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.451832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 336/678] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/role_assignments?user.id=1a782cf2bac541d9b83a99b77fafb9bf&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.452643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.506467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762408f-68a5-44a8-a6de-1b7b6493ed98 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.551074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.551696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.551979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.552251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.552902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.553210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.554698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b47c6-b05b-4810-b1ae-753d6394a9e8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.568003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 343/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.569496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.569786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.570064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.576999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f568177-87b6-44e6-aa4e-c9a006292764 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.590264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:36.591485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:36.615581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.616329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.616681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.617023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.617771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.618148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.619661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.633748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 337/680] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:36.635093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.645535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.668067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 344/681] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:36.673934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.754556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015095a0-fc06-4ace-b05e-43b5eff820cc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.759970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.793550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.794641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.794641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.795029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.802227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.803882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:36.815526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:36.817192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:36.818344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:36.824664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:36.828303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.850970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6caa3f-6494-433f-b565-b68f8eb639d5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.897978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.898924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:36.900075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.900500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.900972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.909135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.911697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:36.925340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:36.926441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:36.927596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:36.930004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 345/683] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:36.938289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:36.945987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7263e-e1b0-4267-8196-2f7e13628418 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:36.984364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:36.984993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:36.985315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:36.985596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:36.986304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:36.986606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:36.988053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.004670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 339/684] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:37.006374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.060729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cac8f4-13b1-4732-ba4f-a25f62891313 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.063884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.098835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.099596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.100070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.100441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.101452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:37.101860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.103447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.127408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 346/685] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:37.128421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.152025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9796-0a07-4fe0-9b57-8877d637e877 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.184175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.198037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.198858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.199234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.199605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.212332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:37.217645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:37.218597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:37.219454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:37.223771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 340/686] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:37.224875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.253625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd772-975a-424a-98a9-7bbd8f15a007 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.299068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.301086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.301629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.302131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.303072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=33c4e0b235524e84b0d003e7dfdb00fd) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:37.303753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.306224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.315594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 347/687] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/role_assignments?user.id=33c4e0b235524e84b0d003e7dfdb00fd&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:37.317028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.343624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fda230-1156-4d2a-bc07-639052d1e162 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.346962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.387208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.388304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.389046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.389796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.431414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fb58-6e1b-447c-bc9d-91948bb008a0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.464314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.474455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.475211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.475765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.476055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.476898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:37.477238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.478859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.484077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.486507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.493540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 348/688] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:37.495497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.594669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.609012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f10fb-839a-41c1-ae66-e65abbd0711c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.624251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 341/689] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:37.634544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.668251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.669004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.669440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.669812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.681143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.682999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:37.700451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:37.701647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:37.702637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:37.702637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:37.702637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:37.708606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 349/690] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:37.709839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.741570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.763234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69b25-b2bb-408d-80af-ba0fa6dc9dbb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.810604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.811405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.812236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.812612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.826077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.827803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.833659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2e9f-f0c2-46df-b6e5-e201926de397 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:37.845632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:37.846641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:37.847547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:37.847547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:37.847547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:37.847547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 342/691] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:37.853857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.873517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:37.874656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:37.875141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:37.875598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:37.876437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:37.877055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:37.879451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:37.889195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:37.893788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 350/692] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:37.900227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:37.996935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b656e8-55f5-479a-ad3c-f6968ca4f698 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.055634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373c95-9b44-4c16-b216-55f8a854f6e0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.064803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.065438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.065722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.065994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.067260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:38.067568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.071175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.089586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:38.091513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 343/693] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:38.095772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.128113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.129408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.129751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.130024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.150991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.152479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:38.170215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:38.171194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:38.172135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:38.174353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 351/694] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:38.182909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.288317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9a0b-bb59-4a19-9398-003a03c05bf8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.308312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:38.328877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.329630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.329912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.330185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.349267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.350658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.358067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58b76-f85b-4b20-8b30-154a1eb19df3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:38.373179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:38.374317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:38.375361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 344/695] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:38.381107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.401051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.402361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.402964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.403398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.404271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:38.404735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.406629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.428565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 352/696] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:38.434802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.492564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:38.552412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91321a5-94a2-4a5f-9017-e5e0be297c30 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.586397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:38.592511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3e2b-2916-4249-90ae-7059093ae40c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.636816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.637448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.637625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.637909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.638607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:38.638917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.640354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.643265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.643883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.644267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.644546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.667744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 345/697] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:38.675222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.749735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.751403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b746056-88c4-463d-b0a2-b971475fe200 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.804903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43b1b-348c-4e4c-97d8-abc34da28320 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:38.825664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:38.849263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:38.850593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.851181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.851724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.852603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=79c09cbdb8dd45f49e430fbf5fe59e25) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:38.853077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:38.854831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:38.865258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 353/699] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:38.865258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bfb5-068e-4749-a14e-271a445b19f5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.865258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bfb5-068e-4749-a14e-271a445b19f5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.865258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bfb5-068e-4749-a14e-271a445b19f5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.866006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 346/699] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/role_assignments?user.id=79c09cbdb8dd45f49e430fbf5fe59e25&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:38.867655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 354/700] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:38.869583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:38.873026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:38.873355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:38.873641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:38.906164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:38.907338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:38.935630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.051101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5bdbc-c143-4d75-ad7b-134dbae55f1c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.060385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 355/701] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:39.090697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.091338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.091618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.091895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.105024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.106630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-667275c0-167b-41fc-85f9-63d87dd80de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:39.124047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:39.125148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:39.126131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:39.126131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:39.126131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:39.126752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 347/702] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:39.132467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.233075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e59d2-6cac-4ee4-bdba-9437684044f9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.233456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e59d2-6cac-4ee4-bdba-9437684044f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.233710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e59d2-6cac-4ee4-bdba-9437684044f9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.235274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 348/703] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:39.240867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.241155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.241467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.244949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfba2f-4a23-4259-b689-7c16ed080aca None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.261183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:39.262407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:39.281367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.281989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.282273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.282551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.283199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:39.283504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.284901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.300693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 356/704] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:39.300928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.302799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.320615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.357601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 349/705] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:39.398518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.437941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155423a-a160-4ab3-a95e-17ea41df1314 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.501505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.502068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.502353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.502685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.517868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.519365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:39.545085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:39.546106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:39.547009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 357/706] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:39.552982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.570352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c83d-e036-4149-be8d-e073fe92c149 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.625176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.625842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.626123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.626400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.626991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.628373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:39.642122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:39.644904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:39.646893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 350/707] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:39.653251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.674451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.682651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.718297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f713f1-4d42-4c99-b1ce-02e5affa6c59 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.767377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.767377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.767377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.767377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.768138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:39.768138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.769721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.771555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f95b7-458f-4687-89e5-573536fd1ebc None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.792801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 358/708] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:39.795054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.817434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.818037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.818387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.818725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.819433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:39.819809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.821442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.830815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 351/709] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:39.831871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.929257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.931966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32654-55a1-4278-9eff-58ccbdd7618c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.941007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33906b49-5e95-4d43-80e9-9ecaa3c3855c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:39.966734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:39.977668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.978371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:39.978529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.978863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.979230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.979606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:39.980045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:39.980240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:39.980620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:39.980767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.982382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:39.993454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 352/710] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:39.994029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:39.994613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:39.995848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:40.014099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:40.015398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:40.016576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:40.016576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:40.016576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:40.018869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 359/711] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:40.030407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:40.129904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19925-58f8-4b01-8c6e-7d0438beacbd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:40.175130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:40.176338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.176617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.176890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.177566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:40.177872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:40.180735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f467870-f8f2-416e-93e1-d5d6a89eb8f9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:40.197589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 353/712] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:40.232921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b49af-e07b-4503-a395-da0e70780f84 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:40.276590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848f73-96a6-42c5-9373-39d2aa16f4f5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.276784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848f73-96a6-42c5-9373-39d2aa16f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.277070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa848f73-96a6-42c5-9373-39d2aa16f4f5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.278992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 354/713] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:40.281336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:40.281649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.281935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.282213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.282944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:40.283340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:40.284624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.284749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:40.285507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.285795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.303901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 360/714] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:40.314595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:40.315844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:40.318587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:40.338671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:40.410853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:40.441922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 355/715] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:40.481615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a009e4-79ee-41b2-8363-993b959302cf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:40.520635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:40.521621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.522222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.522726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.523593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:40.525309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:40.558917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 361/716] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:58:40 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:40.812529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:40.919826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36a8d3-c5cf-4f29-b88a-e10aa956b55c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:40.964751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:40.965427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:40.965713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:40.965986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:40.966580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:40.967956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:40.985356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:40.986413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:40.987256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 356/717] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:40 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:40.994931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:41.143163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:41.161252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1314-a970-473c-bd3d-0cf32077fa03 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:41.203161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:41.203797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:41.204084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:41.204363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:41.205010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:41.205341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:41.206868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283bca9-8b68-40a1-afba-251008adad92 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:41.211938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 362/718] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:41.218304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:41.251219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:41.391041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaea13-a2cf-4974-8f50-7a53614e3ec3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:41.451317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:41.451853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:41.452175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:41.452447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:41.453081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:41.453760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:41.455138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ffad1-fbc6-4729-adc6-ab6c5b5c4cda None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:41.464275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 357/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:41.694440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542d9d-4182-4d6f-9aae-67def25595b3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:41.695123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542d9d-4182-4d6f-9aae-67def25595b3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:41.695669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542d9d-4182-4d6f-9aae-67def25595b3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:41.697528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 363/720] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:41.702924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:41.703168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:41.703429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:41.730555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:41.731817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:41.804062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 358/721] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:42.090656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542d9d-4182-4d6f-9aae-67def25595b3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:42.214871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542d9d-4182-4d6f-9aae-67def25595b3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:42.270433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:42.271129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:42.271408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:42.271679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:42.284831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:42.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:42.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:42.291414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 364/722] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:42.296676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:42.309893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:42.449344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6dce-e61b-43a2-b98e-28cb7bac7e63 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:42.497940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:42.498560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:42.498844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:42.499121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:42.499794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:42.500100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:42.501554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:42.511040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 359/723] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:42.516641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:42.561210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:42.669114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801091-a8a9-453e-91e4-c1b1d34af6c0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:42.718451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:42.719011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:42.719286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:42.719553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:42.730532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:42.731971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-671e0a21-c892-42a8-aa4b-7a3276681e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:42.747286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:42.748313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:42.749191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:42.749191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:42.749191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:42.749191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 365/724] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:42.754525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:42.826557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d754-cb6e-4fea-a454-0796b3c980e9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:42.826869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d754-cb6e-4fea-a454-0796b3c980e9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:42.827107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91d754-cb6e-4fea-a454-0796b3c980e9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:42.828700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 366/725] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:42.835327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:42.835612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:42.835881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:42.857577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:42.877851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:42.879762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:42.927737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46942126-3019-45ad-bb9b-f7e14d494ae1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:42.970733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 367/726] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 13:58:43.006886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.007497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.007773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.008042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.008686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:43.008986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:43.010378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:43.034667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 360/727] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:43.040322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.042982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:43.154937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cbdf9-9831-42d4-b375-083a606e3fab None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:43.190049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.190767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.191115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.191899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.199440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:43.200981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-d6c30622-1a9c-4acb-9532-c7d973ea8200 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:43.212906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:43.213885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:43.214836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 368/728] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:43.220012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.225713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba5f-b8e8-4f3a-be88-737fe29df8f4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.225997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba5f-b8e8-4f3a-be88-737fe29df8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.226275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba5f-b8e8-4f3a-be88-737fe29df8f4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.228813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 369/729] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:43.232733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.233010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.233306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.252059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:43.253249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:43.356067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:43.369006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bf30-2b28-4864-b3da-f1c63e284f03 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:43.384951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 370/730] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:43.384951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.415042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:43.429207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.429845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.430126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.430396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.431132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:43.431436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:43.433736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:43.475586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 361/731] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:43.482339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.534209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8492-af65-47ca-a8df-ebb73e3ff22c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:43.583475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.584509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.585019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.585582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.601942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-112b9fff-14d2-4a5a-ab40-72b64cce222d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:43.607388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:43.608363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:43.609236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:43.611781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 371/732] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:43.618735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d8c9-7065-4dcd-b5c7-3d8551827419 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.619258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d8c9-7065-4dcd-b5c7-3d8551827419 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.619839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4d8c9-7065-4dcd-b5c7-3d8551827419 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.621702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 372/733] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:43.622596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d8c9-7065-4dcd-b5c7-3d8551827419 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.647766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723136-03cc-4d10-a868-134b341d02aa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:43.689622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:43.697617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.698235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.698518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.698795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.743908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4d8c9-7065-4dcd-b5c7-3d8551827419 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:43.770598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:43.780889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:43.784414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:43.786276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:43.786897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.787176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.787447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.788355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:43.788444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:43.789825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641925-dd6b-4ddd-8bbf-4fb788b84cc6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:43.801642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 373/734] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:43.802850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:43.803134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:43.803407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:43.821840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:43.822993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:43.892350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 374/735] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:43.893576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.909106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 362/736] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 13:58:43.911598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:43.948984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.019782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd93bb-6685-4e23-8aa3-d682d185dfc7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.020748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.038931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9514fe-6da5-4abe-8afc-f342364f5d07 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.067360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.069274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.069580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.069864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.071108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.073960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.077160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.078389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.079073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.080266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.101468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 375/737] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:58:43 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:44.101468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.104562 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.107693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:44.142536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:44.143568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:44.145055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:44.145055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:44.145055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:44.148146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 363/738] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:44.153863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.251888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.257954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12021b1e-e78a-417e-b082-10ad6c26fa75 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.301882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.302875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.303122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791eb5-5bb2-481d-9560-7f9d5d8baf16 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.303231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.303406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.316937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.318519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:44.336989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:44.338079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:44.339667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:44.339667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:44.339667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:44.339667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 376/739] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:44.339667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.346585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.347245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.347536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.347812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.348466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:44.348773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.350185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.359309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.366476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 364/740] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:44.366704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.477131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ff07-64ff-4e57-b801-e89f7e045669 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.515969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.516590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.516867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.517138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.517835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:44.518139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.520343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424cc1-1afe-4451-a938-664f51fa9398 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 365/741] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f7cc-f170-4b1b-b82b-726bddcb3d1f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f7cc-f170-4b1b-b82b-726bddcb3d1f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8f7cc-f170-4b1b-b82b-726bddcb3d1f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 366/742] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:44.540416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f7cc-f170-4b1b-b82b-726bddcb3d1f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.574770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda701e-dc2b-4bbb-b823-570e29cc7f9c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.609521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.610209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.610492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.610763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.611417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.622617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f3d059c3-cb16-4876-9863-f3502783c385 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:44.627353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:44.628292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:44.630055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 377/743] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:44.631012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.631238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.631474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.650131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:44.651315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:44.659293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.665838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8f7cc-f170-4b1b-b82b-726bddcb3d1f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.702938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.703566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.703847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.704120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.711871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.713342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.729248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 378/744] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 13:58:44.729248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:44.729530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:44.730602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 367/745] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:44.731786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.849273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983d101-19cb-4046-b07a-c726c26fe099 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.862711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c212e-0515-4d2f-8210-5dcc89a3c135 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:44.868142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:44.886695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.887438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.888011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.888157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.888930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:44.889366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.890842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.904677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 368/746] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:44.905783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.908694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:44.911005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:44.911442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:44.911882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:44.920662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:44.922653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:44.938336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:44.939412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:44.940484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:44.947465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 379/747] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:44.947465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:44.953075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.035713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cdc4-eb41-40ed-b4a7-b14695da09bf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.064659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff28f-2685-4210-b46c-d44f2e91ed22 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.079068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.079678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.079960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.080244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.080973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:45.081309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.083333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.102601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.107967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 369/748] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:45.107967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.108174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.108174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.108174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.118955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.120476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:45.134599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:45.135706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:45.136591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:45.136591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:45.136591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:45.136591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 380/749] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:45.136591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.151561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.197842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.221259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1cef-356a-4114-84e7-e7040c5643fb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.248211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fac08-8b5c-4064-9492-00b12ca2e226 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.259270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.259876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.260161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.260439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.261132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:45.261471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.262900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.276458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 370/750] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:45.277485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.287772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.288385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.288666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.288936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.289627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.291002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.306008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 381/751] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:58:45 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:45.313485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.398896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.404233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690350b-1d1c-4b1a-b890-e98b22cc8284 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.470165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5192c-24b5-4a55-8b07-0e33f0c04aeb None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.470995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.472001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.473003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.474369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.483058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.488319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.489992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:45.511449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:45.512443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:45.513398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:45.513398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:45.513398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:45.513398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 371/752] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:45.513398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.517957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.518586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.518873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.519690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.520550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:45.521937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.526729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.540661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 382/753] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:45.541992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.635488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e44aa-46d1-4ebf-8ee6-f79a14ba7586 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.674553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.675079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.675382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.675657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.676383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=79c09cbdb8dd45f49e430fbf5fe59e25) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:45.676688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.678308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.684200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 372/754] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/role_assignments?user.id=79c09cbdb8dd45f49e430fbf5fe59e25&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:45.684631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0e604-b17f-4825-8f77-81f45126cc0e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.684994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.698911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.733162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.734822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.735307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.735732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.737119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:45.738092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.740099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.767311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 383/755] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:45.770332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:45.820236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d636c29-9e18-4491-a4b9-7ffbbb401750 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:45.863987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:45.864912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:45.866128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:45.866611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:45.867083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:45.877306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:45.880080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:45.895470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:45.896579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:45.897541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:45.900959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 373/756] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:45.906227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.005554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d29a-2b77-4773-9a1e-5800c4032ad0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.023830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:46.078591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58459221-9271-4653-ad0c-1469f4f5949d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.079688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.080334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.080610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.080881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.090552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.092036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:46.111765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:46.112702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:46.113695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:46.114737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 384/757] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:46.119985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.152509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.153120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.153424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.153695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.154430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:46.154734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.156162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.200950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 374/758] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:58:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:46.201923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.313896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855c0ae-7f42-4414-8db4-47e61c5afb98 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.317531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:46.371249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.371863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.372140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.372416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.373116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:46.373451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.374886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbe40c-f47a-48a1-8030-afd8f0dd511a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.393928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 385/759] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:46.395200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca9d2-9cfa-40c4-8a82-9125eb0e70b6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.395486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca9d2-9cfa-40c4-8a82-9125eb0e70b6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.395760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca9d2-9cfa-40c4-8a82-9125eb0e70b6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.399560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf32a75-a923-40af-8e69-b2a6931ccead None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.402053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 386/760] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:46.402781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ca9d2-9cfa-40c4-8a82-9125eb0e70b6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.429909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:46.441644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.442269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.442550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.442820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.522129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ca9d2-9cfa-40c4-8a82-9125eb0e70b6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.530777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.532746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.559220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.559914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.560268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.560547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.562628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=0984655bd84440f0b4baf516e7be88b9, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.564360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b223bb-e59f-4ad2-86c7-1c3472b7ab5f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.581492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 387/761] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:46 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:46.582902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.583240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.583525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.603634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:46.605051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:46.608445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:46.690790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 388/763] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:46.693355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 375/763] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:58:46.698439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.815722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5168fd-dd27-49f7-b57b-6f31a1f08b92 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:46.856377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:46.857028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:46.857341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:46.857619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:46.866943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:46.869924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:46.871694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:46.887885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:46.888874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:46.889803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:46.889803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:46.889803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:46.889803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:46.897182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:46.926002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.002530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1907-a30e-42c0-b0cd-830e36d5fa64 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.042162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.042767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.043050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.043329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.043979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.044285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.045692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.060131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 376/765] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:47.066633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.073607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.181847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480bfc-787d-4a56-bb25-cd4f089f6e7d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.220239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.220874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.221158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.221474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.229376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.231276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.242645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:47.252171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:47.253278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:47.254946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:47.260199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 390/766] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:47.261299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.263806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3029a-2c6c-4fec-9307-481ddc208d7b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.303215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.303843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.304126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.304397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.305270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.306773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:47.318414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:47.320607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:47.321755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 377/767] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:47.325161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.393439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.442706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c356-9091-44ac-a61e-2290f0bf2f5e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.491004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.491619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.491904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.492180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.492816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.493120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.495482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.500494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c00d6-f7f1-4c4a-bcba-7ae987774183 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.508266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 378/768] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:47.512492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.536749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.574950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.575853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.576132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.576403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.577105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.577436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.579020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.604966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 391/769] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:47.606240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.631060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7024e-750d-4f69-a7d9-337cf991be63 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.672217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.672934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.673242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.673523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.674169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.674475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.676557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.682749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 379/770] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:47.690268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:47.755801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32bd1d-b7d2-4360-ba53-11216af665a9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.784445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.806707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.807407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.807751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.808090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.808936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=58e245751afb4ba6a3db98ab30e3ddd1) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.809336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.810855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.821396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 392/771] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/role_assignments?user.id=58e245751afb4ba6a3db98ab30e3ddd1&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:47.873764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:47.907585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cad7-7ae9-4995-be2b-712cdf8f78fd None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:47.966003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:47.966920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:47.967419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:47.967870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:47.968842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] RBAC: Adding query filter params (interface=public, service_id=d16f69ed581444c099ceeb4ba5515356, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:47.969385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:47.970972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1953-584d-4f42-b731-066cef5d9acd None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:47.984362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 380/772] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/endpoints?service_id=d16f69ed581444c099ceeb4ba5515356&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:47.990283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:48.160175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082a0f-418c-4446-a24a-190d6c6a748b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.160749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082a0f-418c-4446-a24a-190d6c6a748b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.161266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082a0f-418c-4446-a24a-190d6c6a748b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.162569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4103d-217d-49ca-a561-1aa6e6fb60b0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:48.163282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 381/773] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:48.168151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402165c-06dc-4ebe-a607-24bbda32eb64 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.168698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402165c-06dc-4ebe-a607-24bbda32eb64 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.169279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402165c-06dc-4ebe-a607-24bbda32eb64 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.170742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 382/774] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:48.171949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.172431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.172913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.192253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:48.194072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:48.199501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:48.200116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.200391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.200660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.201278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:48.202636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256f73-67c0-4386-b2d2-0937aaaa8a12 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:48.209607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 393/775] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:58:47 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:48.210864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.211152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.211426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.230355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:48.231660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:48.276686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 383/776] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:48.280647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:48.335608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 394/777] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:48.595452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:48.676659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:48.682090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:48.704846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798a5f0-0f6a-4258-9269-9f3cabf08259 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:48.741280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:48.742303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.742782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.743255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.753910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:48.759043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:48.759975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:48.760839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:48.763435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 384/778] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:48.777956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:48.880539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf3de-a957-43c5-85ed-86c796f805ca None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:48.934697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802933-0311-4ce5-b536-16882bde330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:48.935451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802933-0311-4ce5-b536-16882bde330b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:48.935724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802933-0311-4ce5-b536-16882bde330b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:48.935992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802933-0311-4ce5-b536-16882bde330b None admin] PATH_INFO: `/v3/services/network` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:48.936682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65802933-0311-4ce5-b536-16882bde330b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:48.938077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65802933-0311-4ce5-b536-16882bde330b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-65802933-0311-4ce5-b536-16882bde330b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:48.949584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:48.950581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:48.951420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:48.952163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 395/779] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:48 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:48.959902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802933-0311-4ce5-b536-16882bde330b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:48.983309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f85d-112e-4fe5-b6d1-f85c8193a9e6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.030556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.176097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802933-0311-4ce5-b536-16882bde330b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.181451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.182063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.182341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.182610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.183282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:49.184437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.189139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.192108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.206338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 385/780] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:49.212291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.249170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.252884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.253216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.254314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.255019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:49.255326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.256791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.266656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 396/781] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:49.274848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.394234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6bbdf-0c29-4445-928b-d2c4554b7a3d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.427905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.431813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9448-0ccb-421a-ad7a-7d2e40b7d22b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.443005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.443708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.443990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.444652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.458163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.460566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.469140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.469846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.470188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.470540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.471236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] RBAC: Adding query filter params (type=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:49.471608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.473177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7984016b-3bd7-4d59-8251-5efd25698b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:49.478150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:49.479287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:49.480387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:49.480387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:49.480387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:49.483961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 386/783] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:49.485214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4798-8cd1-472d-b963-d13201a0ed65 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.485554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4798-8cd1-472d-b963-d13201a0ed65 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.485726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 397/783] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:49.485889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4798-8cd1-472d-b963-d13201a0ed65 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.486491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.487370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 387/784] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:49.488645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4798-8cd1-472d-b963-d13201a0ed65 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.570084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.601280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b0dc-3a04-41d6-909d-cd46d85a7658 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.637941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4798-8cd1-472d-b963-d13201a0ed65 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.638554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.638554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.638893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.639086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.639837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:49.640248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.641660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a55223-43c7-4f01-89a0-a4a8561e5ff5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.654701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 398/785] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:49.655896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.656182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.656458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.676312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:49.677697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:49.685980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.687027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.687309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.687585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.688755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] RBAC: Adding query filter params (interface=public, service_id=21d0c3fd7d6446089f3ec84cb6e26f1c, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:49.689068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.691234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.696057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.698662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 388/786] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/endpoints?service_id=21d0c3fd7d6446089f3ec84cb6e26f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:49.699609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.771176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 399/787] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:49.771176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:49.868692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181c370-0a6a-4e59-bbf6-5a4bebce46aa None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.882566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:49.910601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:49.911235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:49.911704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:49.911979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:49.927531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:49.929194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:49.935745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73708903-e64c-438d-a1d4-dbe31a4f244e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:49.958479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:49.960656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:49.962877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 389/788] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:49.969248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.027634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.028257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.028537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.028810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.029435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.030805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.044016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 400/789] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/services => generated 772 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:50.077602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.108344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed59387-12ea-4149-af39-dbf10c882077 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.128062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.149989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.150749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.151029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.151305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.152155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:50.152470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.153997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.177286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 390/790] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:50.188232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.255036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.297937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417867-327f-48cc-b6f1-80f8f0be19f0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.337823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbdaad-c4d4-4b20-a882-8b1758fe0783 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.343866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.344529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.344796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.345072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.369058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5bfdec60-c800-4d69-895f-8c5908a8d63d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:50.374388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:50.375305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:50.376773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:50.377494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5dfe-74b8-477e-8805-e4029998b3a7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.377494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5dfe-74b8-477e-8805-e4029998b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.377626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae5dfe-74b8-477e-8805-e4029998b3a7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.379649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 402/792] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:50.386044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.386329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.386614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.386820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.387616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.388017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.388410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.402124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.403774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.405186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:50.406407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:50.423707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:50.424718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:50.430467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:50.430467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:50.430467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:50.430467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 391/793] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:50.430467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.504263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 403/794] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:50.505591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.521250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.549239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.607886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417a279-c025-42d6-9449-f369fa3cda50 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.650694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ebb23-6c6c-43b6-9c57-94ea8a259321 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.669580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.670857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.671376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.671846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.672794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:50.673401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.676803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.697184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 392/795] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:50.703103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.724711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.726041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.726548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.727046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.727888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:50.728960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.730884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.756998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 404/796] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:50.762760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.862669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bbbb-767c-4fe0-890e-fc3a5f19bd41 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.883320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.904941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.905883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.906164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.906840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.918082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.919529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.922085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:50.924023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10a32e-b829-4cd5-86ca-f02de480fb0d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:50.934973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:50.935984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:50.936879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:50.936879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:50.936879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:50.940780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 393/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:50.941697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:50.961937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:50.962567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.962850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.963120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.970967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:50.972970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-71334499-3073-4499-b6e5-05931a58eb02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:50.984037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:50.984945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:50.985874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 405/798] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:50.986363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d97a-795c-467d-bd21-86388564e081 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:50.986889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d97a-795c-467d-bd21-86388564e081 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:50.986889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d97a-795c-467d-bd21-86388564e081 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:50.988186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 406/799] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:50.991349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d97a-795c-467d-bd21-86388564e081 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.053976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526e66a-85a4-4812-8bd7-d05a0e2c17a0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.091535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.092454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.092737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.093121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.104406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d97a-795c-467d-bd21-86388564e081 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.105746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:51.111099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:51.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.112938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 394/800] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:51.114225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.145797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.155904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.156520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.157247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.157519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.158166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:51.158474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.160533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468001b-1d0b-484c-84be-032c2261242e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.176144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 407/801] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:51.176144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.176144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.176144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.178375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.191821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:51.193001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:51.225881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97329e-a3ed-465e-b86a-48917d60b50c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.260063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.260658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.269616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.269758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 408/802] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:51.269853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.269853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:51.270040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.270127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.270127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.282502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 395/803] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:51.283389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.375299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26532e88-debd-43ba-8cea-d1abab746edf None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.392135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.400444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f326-8d3d-4da0-b965-b1cadc42aaa3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.412074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.412786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.413067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.413493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.414229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:51.414598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.416102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.421139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.430199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 409/804] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:51.431883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.443770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.444654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.445461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.446207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.455201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.458190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:51.474091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:51.475081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:58:51.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.479175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 396/805] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:51.480207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.545256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6289d-42fd-4aee-b1e3-8a26a17709e2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.580769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.582404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.582695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.583119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/79c09cbdb8dd45f49e430fbf5fe59e25/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.585710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=79c09cbdb8dd45f49e430fbf5fe59e25, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.587253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.602079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 410/806] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:51 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/79c09cbdb8dd45f49e430fbf5fe59e25/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:58:51.602866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.613618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9477e8-f573-43ad-a210-decfe5c1b8f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.658214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.660478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.661379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.661821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.662243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.678256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.681336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:51.700561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:51.701634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:51.702558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:51.702558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:51.702558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.703346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 397/807] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:51.705553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.744245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.747194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ce08b-ea0a-4103-9bdb-5506b6995050 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.803552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.804184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.804555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.804836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.805727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:51.806038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.807478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.824859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1822ec1-4a4a-4cda-bb39-30adc46315a4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:51.828004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 411/808] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:51.828552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.871621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:51.872422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:51.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:51.873188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:51.873902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:51.875361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:51.885123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:51.886491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 13:58:51.887581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:51.893124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 398/809] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:51.893124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:51.958951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:51.967365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54c0a-5494-4fa0-9287-7b513870a08b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.004254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.015189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34522c72-ae73-45de-9602-15f897770f27 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.017357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.017993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.018276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.018553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.020122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:52.020487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.021912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.038030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 412/810] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:52.039183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.061971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.062967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.063449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.063966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.140591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.142448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.184106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010ec5-718b-487c-93c8-d2e28e8fef87 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.233769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.234392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.234682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.234956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.235595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:52.236427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.238652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.240845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.246433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 413/811] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:52.248490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.251629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 399/812] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:58:52.257288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.281105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.366393 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033111c7-f4d7-4135-8c2b-7905d158c6e2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.386690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dd19c-2e32-4c15-b725-9304a7141574 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.411100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.411717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.412001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.412276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.412907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:52.413211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.414602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.419688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 400/813] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:52.420527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.426106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.426837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.427188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.427532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.435859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.437421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-99c8dc3e-a661-4ce2-a57a-11811c05b750 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:52.449393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:52.450571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:52.451702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:52.456697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 414/814] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:52.457898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7075d-2326-4698-99df-e18bb0db15f9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.458191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7075d-2326-4698-99df-e18bb0db15f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.458475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7075d-2326-4698-99df-e18bb0db15f9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.459735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 415/815] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:52.460417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7075d-2326-4698-99df-e18bb0db15f9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.489125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.535834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65787-92d6-431d-8945-0d677f0f067c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.552564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.574638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7075d-2326-4698-99df-e18bb0db15f9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.575636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.576273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.576554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.576828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.588537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.590176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:52.605366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:52.606299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:52.607174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:52.607174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:52.607174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:52.607174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 401/816] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:52.607394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.616308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.616925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.617213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.617513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.618183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.619554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e320601-007d-4c6a-94e0-b0378c92d421 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.642034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 416/817] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:58:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:52.643246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.643535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.643811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.664619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:52.665894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:52.751319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc143c-f7b9-4aaf-acb0-316b273ec01e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.762003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.778023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 417/818] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:52.780265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.822042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.822982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.823447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.823898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.824839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:52.825350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.827011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.859376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 402/819] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:52.861185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:52.867347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:52.910851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6292-ccd6-4a31-8f9b-727464d82e7e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:52.953081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:52.954075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:52.954537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:52.955016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:52.955979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:52.958602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:52.960327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:52.980203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 418/820] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:52.985629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.003063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023baca-cf78-4a86-958d-f49bb301e711 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.049996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.051253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.051757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.052560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.066897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.068390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:53.087048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:53.088032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:53.089812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:53.089812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:53.089812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:53.089812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 403/821] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:53.089812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.104459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c2e49-c23d-4fd1-9658-bee546392531 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.111278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.131403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.146704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.147579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.147868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.148177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.155510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.157218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:53.170238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:53.171125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 419/822] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:53.172411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.211460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79cad8-398d-466c-914b-44b1948e9105 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.251020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.252039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.252514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.253318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] PATH_INFO: `/v3/services/network` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.255042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.256612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:53.268050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:53.269635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 13:58:53.270497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:53.272043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 404/823] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:53.272043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.293526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdeeec9-9dca-429c-b436-3aba6ff17214 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.330219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.330914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.331197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.332077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.332770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.333082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.334598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.352396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 420/824] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.353353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.377600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.409029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ffab3-91f2-451c-84dd-92b31de08a69 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.418982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.445706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.446319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.446598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.446867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.447564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.447870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.449330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.462518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 405/825] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.463430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.493976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2d99-23dd-4784-97c8-54bc88cc989c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.545277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.546490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.547181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.547604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.548602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] RBAC: Adding query filter params (name=network) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.549052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.552076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.561290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 421/826] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.562597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.569162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4b1c-0226-49ba-a134-fb8375cd8100 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.611850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.613825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.614258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.614671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.624366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.626166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:53.640879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:53.641840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 406/827] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:53.643346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.645997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.696504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7744-4b9c-47d2-be9f-996a16c3fc3a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.707790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.745131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.746376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.747176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.747885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.749016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.749537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.751917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.752789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b853-6814-4414-9135-11fde1f0e965 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.760428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 422/828] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.762231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.810166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.810984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.811356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.811730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.813272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] RBAC: Adding query filter params (type=network) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.813688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.815866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.824495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 407/829] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.830654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.901329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522c27e-eedd-42de-94ef-49ed87eb04e5 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.908690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:53.947989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca16cf-8512-494e-96c2-9a8ffbbb9b30 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:53.948307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.948831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.949108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.949405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.950286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:53.951494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.952987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:53.970033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 423/830] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:53.976344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:53.986730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:53.987348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:53.987660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:53.987947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:53.988672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:53.990110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910db4fb-5ccd-4b45-a8f3-61055e4ed9ca None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:54.014591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:54.019552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 408/831] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:58:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:58:54.021989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a36e-30a8-4680-b1b9-bceeaf2b973f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.023338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a36e-30a8-4680-b1b9-bceeaf2b973f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.023647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a36e-30a8-4680-b1b9-bceeaf2b973f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.025424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 409/832] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:54.031183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.032031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.032424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.057591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:54.058885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:54.102761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0a339-1a81-49c2-a9a4-1b69c1f2e35e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:54.163563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:54.165213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.165789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.166279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/58e245751afb4ba6a3db98ab30e3ddd1/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.171123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 410/833] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:54.186998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=58e245751afb4ba6a3db98ab30e3ddd1, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:54.188703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:54.207667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 424/834] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:58:53 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/58e245751afb4ba6a3db98ab30e3ddd1/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:58:54.471758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:54.529013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:54.586272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3c30-4d6f-42b6-8bbb-aff54a83360e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:54.626219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:54.627233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.627734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.628252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.639960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:54.645492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:54.646442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:58:54.647306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:54.649920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 411/835] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:54.655977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:54.737206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:54.763528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9635-e2dd-4fe6-a96e-f81b87e53599 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:54.802170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:54.802789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.803069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.803340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.804016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:54.804319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:54.805810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:54.815103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 425/836] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:54.821434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:54.931269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf5f7a-272e-4ab5-be0e-b28ed25e22ff None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:54.942542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:54.970531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:54.971265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:54.971554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:54.971887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:54.983342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:54.984812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:55.001894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:55.002883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:55.003826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:55.003826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:55.003826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:55.003826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 412/837] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:55.009238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.114412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf9d27-5fd9-4e43-be36-a2c71718ce9f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.151113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:55.151795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.152084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.152364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.153040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:55.153389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:55.154904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec6875-c187-4a60-b67a-3be3a1ce660c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.169646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:55.173630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 426/838] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:55.175810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.265997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64b98-8146-492f-8632-fde0aadba035 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.266356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64b98-8146-492f-8632-fde0aadba035 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.266624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be64b98-8146-492f-8632-fde0aadba035 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.273877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 427/839] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:55.277371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.277371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.277371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.288598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c8a46-2ef1-48db-af49-7b78497d86b3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.295845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:55.297792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:55.329744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:55.330608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.330895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.331175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.340455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:55.342404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:55.357392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:55.358379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:55.359395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 413/840] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:55.364645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.377349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 428/841] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:55.392932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:55.477251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffbaa-b7b5-4bc0-bf9e-a577ceca4f31 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.513248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:55.513248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.513248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.513248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.513613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:55.517311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:55.517311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.533868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 414/842] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:55.540154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.645995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b5ce2-659b-4565-bb01-c316affefb05 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.651396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.683119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:55.683856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.684200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.684547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.693627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:55.751834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:55.753939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.755527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:55.783515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b2661-db18-456e-add6-45c76fbe4681 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.827335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:55.828001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:55.828326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:55.828669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:55.829356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:55.830940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:55.841076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:55.842116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:58:55.842969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:55.847343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 415/843] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:55.848660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.884067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 429/844] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:58:55.885790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:55.945668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:55.985385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5976-b100-4895-8926-db86b5082eeb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:55.997704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d353c16-888f-4435-8331-82ccf2da87da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.027128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.028632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.029288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.029875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.030988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:56.031870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.034255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.040399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 416/845] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:56.041495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.042785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.043288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.043764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.046242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.055552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:56.057568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.059726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:56.080548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:56.081659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:56.082550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:56.082550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:56.082550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:56.085322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 430/846] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:56.088396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.162836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458ec12-f4d3-44f3-96b3-7ea46c389eb1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.206766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:56.209634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.210550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.210937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.211422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.212085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:56.212363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.213768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.224057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 417/847] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:56.237249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2245ba-7cfe-4bfd-8fc2-58ad62081176 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.279207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.280224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.280703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.281189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.282065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:56.282592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.284237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639fa98-16d4-4e26-bbb8-d86bf1ab9d95 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.298503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 431/848] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:56.305152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.352552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8975-b4f6-453f-8888-0cf1e939329c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.352877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8975-b4f6-453f-8888-0cf1e939329c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.353105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8975-b4f6-453f-8888-0cf1e939329c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.354712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 432/849] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:56.360564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b94b-c61e-4c68-95a0-9b3f2f67410a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.360851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b94b-c61e-4c68-95a0-9b3f2f67410a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.361102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b94b-c61e-4c68-95a0-9b3f2f67410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.387121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3af4b94b-c61e-4c68-95a0-9b3f2f67410a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:56.389315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3af4b94b-c61e-4c68-95a0-9b3f2f67410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:56.397859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:56.440132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ca0bd-f736-4a89-9c92-3cf377843d01 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.476668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.477337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.477617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.477887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.479881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 433/850] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:58:56.490797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.492361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:56.504063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:56.505187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:56.506130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:56.506646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 418/851] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:56.509617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599160e7-47bf-437e-9d65-704549ecbc6b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.509967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599160e7-47bf-437e-9d65-704549ecbc6b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.510310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599160e7-47bf-437e-9d65-704549ecbc6b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.511792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.512108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 434/852] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:56.516776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.517065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.517383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.539275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:56.540907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:56.623337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:56.629102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 435/853] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:58:56.642724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509b9e5-72bc-497d-aa9e-7c246a186dec None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.673055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:56.680307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.681169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.681821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.682313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.683239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:56.683734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.685385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.698500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 419/854] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:56.707228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.777062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.819815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0ad5-7589-40cb-8099-668f1ccdd244 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.856477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.857513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.857991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.858600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.860008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=79c09cbdb8dd45f49e430fbf5fe59e25) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:56.860778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.863462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.870899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 436/855] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/role_assignments?user.id=79c09cbdb8dd45f49e430fbf5fe59e25&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:56.900057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61729f-e337-4652-a443-893d61a38f52 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:56.903370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.947287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:56.947975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:56.948890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:56.949182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:56.949831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:56.951697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:56.965319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:56.966325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:56.967768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 420/856] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:56.974310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:56.977746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.026746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a991-2f33-4c85-b72b-d93ba3ccb83b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.040333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.077039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.078335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.078616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.078893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.093307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:58:57.098622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdf6c4-6561-4e5a-8995-8670a9329e64 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:58:57.100582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:57.101601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 13:58:57.102628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:57.103280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 437/857] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:58:57.109215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.147320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.148177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.148455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.149453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.150213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:57.150469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.151864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.163539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 421/858] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:58:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:57.170840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.225799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d9604-6a1d-4515-bb15-718d22418798 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.259283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.272132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.272745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.273025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.273327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.273998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:57.274302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.276047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.289186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 438/859] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:57.290279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.312434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270696c-9cfb-4252-995e-53a6609495a8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.338028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.362119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.363391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.363897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.364622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.366642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:57.367161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.368754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.380042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 422/860] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:57.406765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70996-9c2a-43b1-b7a2-1148421de034 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.447045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.447954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.448410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.448833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.461844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.463588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:57.479994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:57.481262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:57.482398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:57.482398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:57.482398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:57.484207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 439/861] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:57.491062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.604194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a86e-d488-4964-9590-54159dd2f699 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.640427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.641043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.641353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.641660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.642350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:57.642661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.644133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.656960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 423/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:57.662196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.709384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.779078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e71da-477f-43ac-b168-120e1271adc4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.815006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.815719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.816521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.816800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.825033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.826593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:58:57.838587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:57.839528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:57.840475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 440/863] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:57.848040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:57.892627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:57.957919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9f71d-984f-4b29-9b37-230d761a03ca None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:57.993940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:57.994540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:57.994816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:57.995088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:57.995808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:57.996108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:57.997550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:58.015451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 424/864] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:58:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:58.021075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.121357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:58.125153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea322-7a12-4a2f-95cb-ec34a6a0064e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:58.165555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:58.166176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.166459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.166732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.238391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:58.239869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631f09-58d9-49e5-bc3c-c47439a7b867 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:58.344420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:58.353375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 441/865] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:58:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:58:58.356505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.470479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:58.474451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364f09-d704-459e-9d8f-5bf769240837 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:58.510540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd443-769f-470b-b241-087d445374b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:58.511465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd443-769f-470b-b241-087d445374b0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.511925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd443-769f-470b-b241-087d445374b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.512375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd443-769f-470b-b241-087d445374b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.523039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afd443-769f-470b-b241-087d445374b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:58.524698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afd443-769f-470b-b241-087d445374b0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:58.537728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817214-451b-40e9-9e64-6620a4a4eda5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.538023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817214-451b-40e9-9e64-6620a4a4eda5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.538308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817214-451b-40e9-9e64-6620a4a4eda5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.539893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 442/866] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-05afd443-769f-470b-b241-087d445374b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:58:58.540964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:58.541912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:58:58.542793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:58:58.542793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:58:58.542793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:58:58.544695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.544855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 425/867] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:58.544954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.549404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.550921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd443-769f-470b-b241-087d445374b0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.566261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:58.567721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:58.653561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 443/868] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:58:58.660145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd443-769f-470b-b241-087d445374b0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:58.694184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:58.694783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.695068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.695343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.695984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:58.696289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:58.697684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:58.710596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 426/869] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:58.716212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.821833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b37cf-00a5-453e-9005-54ade95a8246 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:58.849623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:58.857837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:58.858473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:58.858753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:58.859029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:58.866814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:58.868333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:58:58.879301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:58.880195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:58.881128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 444/870] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:58:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:58.886317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.905617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:58.952454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:58.998231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d87c1b-24d9-4fc5-ae37-8a397ab819be None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:59.038717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:59.039247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.039586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.039865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.040552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:59.040857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:59.042316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:59.055411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 427/871] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:59.061283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:59.073177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9cf20-74cd-4405-8bd6-2a3efe52bf26 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:59.112391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:59.112998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.113307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.113581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.114225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:59.115851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade80083-e242-42fd-9216-b2d12ad13f1e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:59.141252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 445/872] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:58:58 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:58:59.141252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490473fa-79fe-4e90-9100-2eaf8ab6862e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.141252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490473fa-79fe-4e90-9100-2eaf8ab6862e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.141252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490473fa-79fe-4e90-9100-2eaf8ab6862e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.141252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 446/873] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:58:59.142219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.142219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.142538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.149474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:59.163124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:59.164331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:59.195461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd53e-75fc-474d-9b26-afce83207fc5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:59.219599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:59.259936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:59.260552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.260885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.261166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.261950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=58e245751afb4ba6a3db98ab30e3ddd1) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:59.262261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:59.263727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:59.269951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 447/874] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:58:59.274874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 428/875] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:58:59 2022] GET /identity/v3/role_assignments?user.id=58e245751afb4ba6a3db98ab30e3ddd1&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:58:59.532150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:59.640851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a4cb-480b-4f34-9da6-9ddef98e405a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:59.679333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:59.679967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.680244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.680513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.681101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:59.682486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-22a4982f-48cf-4f97-9a13-a8f7853d0be5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:58:59.692207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:58:59.693326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:58:59.694255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 448/876] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:58:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:58:59.699443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:59.751310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bbde8-606e-4c7a-ac3b-df3bb7b89eeb None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.751652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bbde8-606e-4c7a-ac3b-df3bb7b89eeb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.751846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bbde8-606e-4c7a-ac3b-df3bb7b89eeb None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.753917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 449/877] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:58:59.759094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.759376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.759647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.783528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:58:59.783528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:58:59.821663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:59.827873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63b63-d249-4a7b-bc91-8c0fcb829ff5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:58:59.860434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:58:59.868166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:58:59.868927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:58:59.869297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:58:59.869635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:58:59.870437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:58:59.870807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:58:59.871705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 450/878] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:58:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:58:59.873967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:58:59.879992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 429/879] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:58:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:58:59.885623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:58:59.986106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1c5f7-a9e6-4e87-92ed-1ac57c084b62 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:00.024968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:00.025905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:00.026391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:00.026859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:00.027677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:00.028155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:00.029732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90e23-675f-494a-ad69-2fda2d255778 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:00.034622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 451/880] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:58:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:00.161937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:00.276154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfaff9-7cbf-44fc-8cae-81193333bd44 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:00.312046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:00.312592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:00.312920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:00.313285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:00.313967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:00.315439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cc6a-5461-45c6-99da-4e81df45b2bf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:00.341375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 430/881] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:00 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:01.381146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f155-030b-41a4-aa7e-a7523051864a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:01.381723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f155-030b-41a4-aa7e-a7523051864a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:01.381723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f155-030b-41a4-aa7e-a7523051864a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:01.383337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 452/882] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:01.388521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf5a2-ebc9-4cca-9b01-8604760bbde8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:01.388919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf5a2-ebc9-4cca-9b01-8604760bbde8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:01.389098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bf5a2-ebc9-4cca-9b01-8604760bbde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:01.408012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3c5bf5a2-ebc9-4cca-9b01-8604760bbde8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:01.409214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c5bf5a2-ebc9-4cca-9b01-8604760bbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:01.467881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:01.498070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 431/883] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:01.597752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2cff-bf62-4dfe-bd22-5f37564b25ec None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:01.598108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2cff-bf62-4dfe-bd22-5f37564b25ec None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:01.598698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2cff-bf62-4dfe-bd22-5f37564b25ec None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:01.599951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 453/884] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:01.606516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:01.606809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:01.607090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:01.627791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:01.629975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:01.705752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 432/885] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:01.768614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2cff-bf62-4dfe-bd22-5f37564b25ec None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:01.803317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:01.879452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2cff-bf62-4dfe-bd22-5f37564b25ec None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:01.913968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:01.914766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:01.915047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:01.915320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:01.915952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:01.917370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:01.926954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:01.927985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:01.928838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 454/886] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:01.936082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:01.977201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.054248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff703-1e24-4a34-85db-7def3ebf6861 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.069974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.091271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.093510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.094310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.094765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.095253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.096051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:02.096513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.098141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.098611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc1c77-d282-4d78-93d5-a5339c0ae4da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.104892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 433/887] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:02.110591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.150051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.150717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.150999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.151577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.171049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:02.178432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:02.179408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:02.180282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:02.187731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 455/888] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:02.188853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.233803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ee0a4-d2e2-4b5c-ae9a-1492e9ab940b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.279559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.280442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.280727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.281001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.281904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:02.282587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.283968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a162a-5e71-4191-b251-ebcda57eac2e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.291518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 434/889] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:02.292859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c38be-8255-4597-a0a3-1ed95d4f1f65 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.293211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c38be-8255-4597-a0a3-1ed95d4f1f65 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.293591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c38be-8255-4597-a0a3-1ed95d4f1f65 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.294895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 435/890] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:02.296779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c38be-8255-4597-a0a3-1ed95d4f1f65 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.307704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee4974-97c0-4120-a140-f7b003fbb3f6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.343552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.344165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.344451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.344734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.345436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:02.345744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.347748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead426-8abd-483e-9bf0-2b92561686fa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.349834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.360813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 456/891] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:02.360813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.360813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.360813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.377382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:02.378635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:02.392179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.425572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c38be-8255-4597-a0a3-1ed95d4f1f65 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.447897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 457/892] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:02.448561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.481907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.482856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.483368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.484122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.490831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] RBAC: Adding query filter params (interface=public, service_id=0f764650da7c4c3bab84ac0f38ba1463, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:02.491380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.493867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.507245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 436/893] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/endpoints?service_id=0f764650da7c4c3bab84ac0f38ba1463&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:02.509685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.561854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fff35-0860-45e4-bdcf-2d2385bec05e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.599998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.600654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.600932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.601201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.612187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.613781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.623696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a3a186a5-8259-4507-98b8-45917d4e51ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:02.632051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:02.633256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:02.634367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:02.634367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:02.634367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:02.637533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 458/894] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:02.638625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff3e4e-8dcd-4bfa-85e3-78dd2c6f4ef8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.638906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff3e4e-8dcd-4bfa-85e3-78dd2c6f4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.639175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff3e4e-8dcd-4bfa-85e3-78dd2c6f4ef8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.640563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 459/895] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:02.644957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff3e4e-8dcd-4bfa-85e3-78dd2c6f4ef8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.651212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a49af-15ee-4770-b158-7f7a04c3dc6f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.654176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.688877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.689527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.689810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.690080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.691297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.692650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d24bd-245a-43b4-b811-bbeac26f186a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.705255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 437/896] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 13:59:02.705255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.705255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.705255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.719390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:02.720895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:02.762243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff3e4e-8dcd-4bfa-85e3-78dd2c6f4ef8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.796924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 438/897] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:02.797815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.810563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.812239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.812756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.813251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.814468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:02.815565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.818341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.840170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 460/898] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:02.842108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:02.917562 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.918702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:02.922806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818daa5-bb23-4d60-9336-f67616b1d38c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.968423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005898f8-b7df-480d-97aa-958d1bf2e1a2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:02.970094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:02.971665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:02.972134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:02.972562 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:02.973382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:02.974921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:02.997968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 439/899] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:02 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:03.024007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.024646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.024929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.025204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.034792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.036280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:03.049507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:03.051240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:03.052498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 461/900] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:59:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:03.059157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.072449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.190028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37b59c-d24c-4787-96f0-a926ec8386c1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.208456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336773bb-6783-4045-a8c6-7a458dfbb570 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.230264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.235446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.237037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.237972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.238193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.238946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:03.239433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.241180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.255397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.256103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.256387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.256660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.257315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.258824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.265681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 440/901] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:03.269909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:03.270883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:03.271771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 462/902] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:03.274209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.274918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.296848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.395866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83416-a0f4-478f-883e-bf6b09489ad6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.399593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81ca9-d13d-465d-bdd0-e1c6faf6b257 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.438776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.440228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.441087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.441844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.446684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.447364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.447657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.447934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.448571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:03.448877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.450298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.457321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 463/903] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:03.463159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.524949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.526467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.528137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.550618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.593584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220220da-03b6-48c1-a451-259f6c1bf2e9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.635177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.635796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.636081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.636358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.637450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:03.637759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.639672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.647490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 464/904] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:03.655470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 441/905] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:03.658208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.658340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.781694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79b7f8-fd30-4425-a796-e0c8f6fcb751 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.783272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb6e5b-d2ac-46e5-b4f0-a272f6d0373e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:03.795637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.802906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:03.828105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.828673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:03.828880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.829251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.829649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.829951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:03.830433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:03.830545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] RBAC: Adding query filter params (interface=public, service_id=17e8bafcfa664548b0065b0c34b7e49b, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:03.830931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.831143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:03.832985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.838960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 442/906] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/endpoints?service_id=17e8bafcfa664548b0065b0c34b7e49b&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:03.844606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.845675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:03.847390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:03.862521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:03.863487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:03.864378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:03.864378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:03.864378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:03.866875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 465/907] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:03.873219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:03.977801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce664b-dc5c-4513-b780-5112beb90e7a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:04.020279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc53e6-f7ad-4fec-82eb-d7a143151369 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:04.028771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:04.029494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.029782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.030056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.030671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:04.033096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:04.049266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 443/908] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 13:59:04.066658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:04.067296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.067582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.067861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.068523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:04.068831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:04.070278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:04.084824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 466/909] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:04.090351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:04.143116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:04.203882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29192-f633-4f83-8200-062debe4c374 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:04.242804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:04.243777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.244115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.244397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.253716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:04.255215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:04.268057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:04.269048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:04.270094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 444/910] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:04.276805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:04.299290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:04.382977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa65202-d91a-406d-90b8-566023b56367 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:04.418281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:04.418906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.419193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.419468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.420174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:04.420480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:04.421939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988484ce-a994-451e-949d-7b80bf870209 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:04.434760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 467/911] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:04.441495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:04.548317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b57c4-0389-47b2-92a2-96907fce0594 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:04.551656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:04.586747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:04.587739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.588224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.588708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.589659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] RBAC: Adding query filter params (role.id=fe5ccc00f6394e199583e3e78ea0c4b5, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=58e245751afb4ba6a3db98ab30e3ddd1) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:04.590169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:04.591813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846196f-cf58-4522-a83c-faa9eacb1856 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:04.598680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 445/912] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:04 2022] GET /identity/v3/role_assignments?user.id=58e245751afb4ba6a3db98ab30e3ddd1&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=fe5ccc00f6394e199583e3e78ea0c4b5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:04.994195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd14b0-3fcc-48ab-8c6b-ca8e8b2bbd75 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:04.994724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd14b0-3fcc-48ab-8c6b-ca8e8b2bbd75 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:04.995150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd14b0-3fcc-48ab-8c6b-ca8e8b2bbd75 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:04.996895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 468/913] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:05.003577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20afa-443a-4c7c-9fb2-4d088cdcd2bf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.004135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20afa-443a-4c7c-9fb2-4d088cdcd2bf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.004561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20afa-443a-4c7c-9fb2-4d088cdcd2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.024884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ade20afa-443a-4c7c-9fb2-4d088cdcd2bf None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:05.026387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ade20afa-443a-4c7c-9fb2-4d088cdcd2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:05.095885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 446/914] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:05.313261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60227b6-2664-4318-91a4-da9dd373850c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.313506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60227b6-2664-4318-91a4-da9dd373850c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.313864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60227b6-2664-4318-91a4-da9dd373850c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.315530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 469/915] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:05.321371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.321737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.322090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.340520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:05.341985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:05.376220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60227b6-2664-4318-91a4-da9dd373850c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.412668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 447/916] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:05.470626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:05.493815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60227b6-2664-4318-91a4-da9dd373850c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:05.535313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:05.535944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.536224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.536495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.537075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:05.538474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:05.547342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:05.548321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.549160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 470/917] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:05.557045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.586737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:05.662532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f983-f883-4aa8-9d61-2a27976ff514 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:05.692652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.698919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:05.699800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.700309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.700796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.701669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:05.702184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:05.703763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:05.709888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 448/918] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:05.715640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.810952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce235-0660-4329-b3f5-b07b7bcd71ec None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:05.812212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:05.821604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf5007-c4bd-40f0-b8dc-db2095afb09d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:05.851476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:05.852492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.853028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.853509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.854293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:05.856151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:05.857992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:05.858672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:05.859015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:05.859354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:05.860100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:05.860464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:05.861908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:05.867544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:05.868519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:05.869391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:05.870129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 449/919] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 13:59:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:05.875284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 471/920] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:05.875431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.878075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:05.891632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:05.982654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8fb8-accc-4993-9338-847582c85dc2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:05.991005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a0181-ff12-4c77-b3ee-5d5f23103b7d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:06.016912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.017541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.017823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.018094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.019287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.020640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.030665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.031610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.032124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.032376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.033126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:06.033488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.035579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.043442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 450/922] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:06.045663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 472/922] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:06.046846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:06.064933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:06.168521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eba2-39d8-48c6-81cc-1329244cef3a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:06.207555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.208570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.209051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.209584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.210523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:06.211028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.212445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51fbaa-bd97-47eb-b090-fd17dfda3944 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.218705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 451/923] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:06.224433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:06.303170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:06.336153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b1e8-fb15-454b-a445-c3ceb119b7da None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:06.343795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f44d5-5ae9-454f-a780-fce2dd4b377c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.344078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f44d5-5ae9-454f-a780-fce2dd4b377c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.344352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f44d5-5ae9-454f-a780-fce2dd4b377c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.345980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 452/924] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:06.351051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.351333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.351612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.370576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:06.371972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:06.374032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.374955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.375413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.375861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.376808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] RBAC: Adding query filter params (interface=public, service_id=d8bb712c30594f2190a6384b2998c283, region_id=RegionOne) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:06.377323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.379575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.388342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 473/925] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:59:06 2022] GET /identity/v3/endpoints?service_id=d8bb712c30594f2190a6384b2998c283&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:06.394874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:06.449463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 453/926] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:06.504368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b63ec7-7695-4cd5-a712-2fa9da1fd603 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:06.539509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.540411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.540870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.541377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.542171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.543706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f8be0-3e2b-4fd0-8b47-979ca7514749 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.545773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:06.551708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 474/927] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:06 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 13:59:06.715014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:06.716276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:06.822947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff818-554a-4604-8c8e-ef8b5165fadd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:06.858357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:06.858992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.859271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.859540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.860124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:06.861513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:06.866175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1429bf-5fca-4c73-8478-c660208c6fee None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.866535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1429bf-5fca-4c73-8478-c660208c6fee None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.866907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1429bf-5fca-4c73-8478-c660208c6fee None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.868607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 475/928] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:06.871857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:06.872816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 13:59:06.873747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:06.874486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:06.874486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:06.874486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:06.877539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 454/929] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 13:59:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:06.879087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:06.893352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:06.894565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:06.948600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:06.967244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 476/930] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:06.994837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64372a-0fe7-46ab-ab8b-3bb82f20f4f0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.032262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.033138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.033580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.033992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.034821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:07.035282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.036798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:07.042051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 455/931] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:07.047954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.148832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07a344-36b5-4890-b12a-7ea8002692ff None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.177816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:07.184011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.184816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.185314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.185725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.186539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:07.186980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.188538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:07.194648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 477/932] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:07.200384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.267782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.314082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab77d2-e6f2-4697-875e-1b239b3a76f1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.354857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:07.361027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.361665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.361942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.362732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.363690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.366281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:07.397441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 456/933] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:07.407048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83595-f50d-48f2-b5d7-b971294cf518 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.456933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.457675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.457946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.458217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.471135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:07.476818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:07.477862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:07.478743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 478/934] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:07.486439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.604063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a46d2-1f38-4fb4-afee-ad8d801d4441 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.638907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.639503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.639785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.640215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.640844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:07.641146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.642532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:07.651171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 457/935] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:07.657172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.713611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:07.773077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f565b1-97cf-4748-be3e-c0b5ef76187f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.809697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.810328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.810601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.810869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.822128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.823581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:07.837740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:07.838707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:07.840161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:07.840161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:07.840161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:07.840161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 479/936] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:07.844674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:07.899842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:07.953245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdefc7f-6787-4ad2-87b4-7904d0efcf48 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:07.988381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:07.988988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:07.989604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:07.989874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:07.990779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:07.991079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:07.992437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.004854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 458/937] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:08.010277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.116505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff397b-c1d8-4d68-9c07-d88c5e0e809a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.118101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:08.152619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.153171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.153498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.153770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.161604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.163060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:08.174971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:08.176005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:08.177103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 480/938] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:08.182104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.292505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d650a-57d3-4bbb-b0b3-b5cb66c7b0f8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.303978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:08.339780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.340766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.341275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.341750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.342688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:08.343230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.344901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea6f7-836b-4cf7-95f6-42ec89d9053a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.366289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 459/939] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:08.374216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.416540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d628f-be7c-4010-bbac-b6de7b0819f2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.416731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d628f-be7c-4010-bbac-b6de7b0819f2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.417006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d628f-be7c-4010-bbac-b6de7b0819f2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.418485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 460/940] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:08.423405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.423853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.424149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.444679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:08.445892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:08.479451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad5abb-2279-4873-bdc4-fb5eff487ccf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.513013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.513737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.514025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.514303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.525659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.527176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.527848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 461/941] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:08.549655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:08.550677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:08.551592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:08.551592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:08.551592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:08.551592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 481/942] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:08.557852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.655321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:08.662132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a866f-0cdf-4a5b-8e1b-a68e514efcec None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.697610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.698142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.698418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.698688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.699322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:08.699622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.700973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.712794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 462/943] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:08.718378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.736236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:08.803629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.844730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954229-63fb-4e36-9d12-f3ffd4eae514 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.884580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.885650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.886126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.886589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.895081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.896515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:08.912440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:08.913640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:08.914577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:08.921261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 482/944] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:08.923695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:08.936051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37aada-733a-466a-9543-fe8776fc0e54 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:08.970659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:08.971630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:08.972120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:08.972599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:08.973464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:08.975065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:08.977891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING keystone.server.flask.common [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 05 13:59:08.997787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.sql.core [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 13:59:08.997787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 13:59:08.997787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [parameters: {'id': '871397b26a274413b66c19d8c5af9a5c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 13:59:08.997787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81612) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 13:59:09.004328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6c745eb2-f848-4877-9153-a2859b51d7b2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 871397b26a274413b66c19d8c5af9a5c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 871397b26a274413b66c19d8c5af9a5c. Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:59:09.016095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 05 13:59:09.016960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application yield resource Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise self.value Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application session.commit() Oct 05 13:59:09.022362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.session.flush() Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application compat.raise_( Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 13:59:09.023386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 13:59:09.029064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application result.read() Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:59:09.030095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [parameters: {'id': '871397b26a274413b66c19d8c5af9a5c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.030990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:09.031770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 871397b26a274413b66c19d8c5af9a5c. Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 463/945] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 5 13:59:08 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df941-1f7a-4a3d-85ad-e57da56f2293 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.032644 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df941-1f7a-4a3d-85ad-e57da56f2293 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.033319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df941-1f7a-4a3d-85ad-e57da56f2293 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.033319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 464/946] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:09.033319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df941-1f7a-4a3d-85ad-e57da56f2293 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.038202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41e78-36b8-409a-89f4-a13efc433e9c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.046613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.077189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.077847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.078132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.078409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.079111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:09.079421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.080866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5661-6f00-4aab-b042-443ccd611e43 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.093078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 483/947] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:09.098487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.098782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.099061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.118726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:09.119924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:09.141891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df941-1f7a-4a3d-85ad-e57da56f2293 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.181015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.181894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.182316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.182755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.197258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 484/948] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:09.197258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.205881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.205881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:09.212606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:09.213510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:09.214443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 465/949] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:09.220866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.264818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.313829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b374190-6d8c-4b27-829c-0a6ad4145466 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.314186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.355146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6882077-5bbd-4ac2-977c-61ab11159f00 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.355542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.356281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.356637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.357026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/58e245751afb4ba6a3db98ab30e3ddd1/roles/fe5ccc00f6394e199583e3e78ea0c4b5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.360079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=58e245751afb4ba6a3db98ab30e3ddd1, role_id=fe5ccc00f6394e199583e3e78ea0c4b5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.361693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.389511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 485/950] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:59:09 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/58e245751afb4ba6a3db98ab30e3ddd1/roles/fe5ccc00f6394e199583e3e78ea0c4b5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:59:09.398337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.399017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.399361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.399636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.400368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:09.400674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.402656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd80b7-ce79-401f-8fe5-d3d3ed8b293a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.426673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 466/951] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:09.478065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.606830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe137-d35f-4b5f-bbd5-c154ccaeb57e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.635839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.647464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.648193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.648545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.648882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.649620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.651131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.661277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84e80-44b7-4fff-aebd-361d8a1f1f7d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.661579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84e80-44b7-4fff-aebd-361d8a1f1f7d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.661844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84e80-44b7-4fff-aebd-361d8a1f1f7d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:09.662356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:09.663464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:09.664659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:09.666134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 467/952] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:09.668294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.668601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.668868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.670627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 486/953] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:09.673958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.695540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:09.697087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:09.794721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f4c2-9c2d-46bb-b61b-0c2c6648194b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.796840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 468/954] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:09.835584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.836192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.836470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.836741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:09.837404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:09.837704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:09.839131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:09.844314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 487/955] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:09.850595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:09.917206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:09.957829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa1cf-1bc0-442b-94cc-1247eaa981cc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:09.998435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:09.999057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:09.999340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:09.999616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:10.000253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:10.000556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:10.001963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:10.007588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 469/956] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:10.013379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:10.069318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:10.119284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:10.124153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45a4c-bf5d-4136-8b77-57aef297d31f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:10.169964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:10.170579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:10.170859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:10.171131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:10.171820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:10.173197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:10.204011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 488/957] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:10.252677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee672f-6509-4876-87ab-f2a852a61f8f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:10.286751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:10.304571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:10.305473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:10.305751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:10.306050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:10.307311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:10.310204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:10.322064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:10.323183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:10.324065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 470/958] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:10.333612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:10.441766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac0f4-86b0-4e1f-b148-46ae72e57ce4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:10.451298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:10.479741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:10.480691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:10.481255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:10.481738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:10.482663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:10.483172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:10.484752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87738a-fc74-4ad7-b596-af7439d29f34 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:10.490751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 489/959] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:10.496935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:10.607008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a1b58-84d5-42ae-bcf1-ab0012fee490 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:10.642088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:10.643115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:10.644222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:10.644775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:10.645654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:10.646163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:10.647756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd07b8-6405-43d0-8c7b-d7db3d67a1a5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:10.654322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 471/960] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:11.637118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c9e9-c21f-46a5-b83c-2e94750bbfb1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:11.637713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c9e9-c21f-46a5-b83c-2e94750bbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:11.637713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72c9e9-c21f-46a5-b83c-2e94750bbfb1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:11.639241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 490/961] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:11.644973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fed4-88e0-4ab4-9b19-838944c2b120 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:11.645389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fed4-88e0-4ab4-9b19-838944c2b120 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:11.645615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fed4-88e0-4ab4-9b19-838944c2b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:11.664419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-83c8fed4-88e0-4ab4-9b19-838944c2b120 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:11.665643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-83c8fed4-88e0-4ab4-9b19-838944c2b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:11.714543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:11.738601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 472/962] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:11.829252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93572a50-3d20-4b5a-911c-c6104bd14544 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:11.829689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93572a50-3d20-4b5a-911c-c6104bd14544 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:11.830068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93572a50-3d20-4b5a-911c-c6104bd14544 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:11.832252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 491/963] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:11.837583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:11.837871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:11.838147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:11.856948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:11.858159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:11.930221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 473/964] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:12.021947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93572a50-3d20-4b5a-911c-c6104bd14544 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.129886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93572a50-3d20-4b5a-911c-c6104bd14544 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.164324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.164947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.165241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.165525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.176429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:12.181165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:12.182114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.183005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 492/965] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:12.190116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.203905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.237213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.301439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad7c1-b7ac-4fed-af03-be613fbe5d72 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.310911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b189bb2-db95-4073-b926-0f1c4a15453c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.313565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.338847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.339851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.340334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.340806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.341727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:12.342326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.343946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.348289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.348922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.349202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.349511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.350176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.351672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.354406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING keystone.server.flask.common [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 05 13:59:12.362008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 474/966] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:12.363933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.369811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.sql.core [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 13:59:12.369811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 05 13:59:12.369811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [parameters: {'user_id': '3c0973db4a31403bac02c508224e7d3e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 05 13:59:12.369811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 05 13:59:12.378294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:59:12.379274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application yield resource Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application next(self.gen) Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise self.value Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application session.commit() Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 13:59:12.380392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.session.flush() Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application compat.raise_( Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 13:59:12.381318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 13:59:12.384242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application conn.query(q) Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application result.read() Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 13:59:12.386494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [parameters: {'user_id': '3c0973db4a31403bac02c508224e7d3e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:12.388756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 05 13:59:12.390924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 493/967] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 13:59:12 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:12.393819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.488585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747de7-9e10-4f59-aaf3-0a0a3a2b034f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.490927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.501333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af709d1-c467-4384-9361-0f28a03a77e0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.524008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.524767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.525155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.525464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.536616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.538198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.539384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.540178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.540462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.540733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.549308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.550967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-4014b5e4-67fd-4d8e-81de-030a4265dc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:12.553571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:12.554703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:12.555819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:12.555819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:12.555819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:12.559468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 475/968] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:12.560684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebf8-4c29-4764-8427-270fb997f8c1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.560966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebf8-4c29-4764-8427-270fb997f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.561256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57ebf8-4c29-4764-8427-270fb997f8c1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.562622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 476/969] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8c5660fa-6df8-466c-bf03-9bcdf16688ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:12.565040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:12.566023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:12.567493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 494/970] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:12.569990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57ebf8-4c29-4764-8427-270fb997f8c1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.571366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cac-078a-4560-9a57-e5945a369104 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.571647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cac-078a-4560-9a57-e5945a369104 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.571921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315cac-078a-4560-9a57-e5945a369104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.591292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-89315cac-078a-4560-9a57-e5945a369104 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:12.592816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-89315cac-078a-4560-9a57-e5945a369104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:12.602185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.662228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 495/971] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:12.663731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315cac-078a-4560-9a57-e5945a369104 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.698877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57ebf8-4c29-4764-8427-270fb997f8c1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.740756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.741629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.741910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.742181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.743509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:12.743832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.745628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.771796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 477/972] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:12.779265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:12.787901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.804484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89315cac-078a-4560-9a57-e5945a369104 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.848146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.848760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.849038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.849341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.850049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:12.850352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.852312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d40d0-4fe8-4c6e-b734-765e8c0fa0e6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.888847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:12.896304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 496/973] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:12.897591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73eb95-7e09-4dfd-8be2-02fb38efd8ac None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.897885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73eb95-7e09-4dfd-8be2-02fb38efd8ac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.898164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73eb95-7e09-4dfd-8be2-02fb38efd8ac None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.899539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 497/974] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:12.905245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.905583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.905804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.914411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c984-a0bf-491f-a28d-ef322fd09a34 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:12.926088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:12.927324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:12.958147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:12.958913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:12.959092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:12.959377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:12.968094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:12.969592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:12.982831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:12.983887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 478/975] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:12.991155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.012794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 498/976] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:13.013616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.092521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.123136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9270e-3a01-40bb-9e91-aee1966c46ef None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.136226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c483db-63a6-4da9-a78b-e45b8e14deb4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.166930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.167573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.167850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.168118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.168696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.170249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.177098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.178169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.178455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.178724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.179454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:13.179763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:13.180353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:13.181325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:13.182178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:13.182955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.185370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 479/977] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:13.188774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.200577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.205462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 499/978] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:13.212652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.296166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd27c-1684-4e90-954f-e707f0d11978 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.314196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeed8f-4f5a-42e5-a399-6b42fd1f08a4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.328955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.329578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.329855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.330135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.330742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:13.331573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.332919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.337407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 480/979] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:13.338149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.342803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.349745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.350361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.350643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.350920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.411041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.416875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.418387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.440275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa738-37fd-4b28-af6f-e91119bf787b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.473854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.474448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.474726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.474996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.475631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.477008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.490958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 481/980] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:13 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:13.491740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.524177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 500/981] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:13.525657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.560677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.617151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257d6a-f4ec-41dd-94d2-03675fcb5f71 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.646529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d191-83ca-478a-8d1f-5012071f64b4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.650260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.659973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.660580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.660860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.661133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.661884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:13.662185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.663547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.673940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 482/982] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:13.675204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.691529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.692174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.692585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.692860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.703459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.704920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:13.720181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:13.721463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:13.722578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:13.722578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:13.722578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:13.722578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 501/983] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:13.727217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.797610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd7a9-41c1-4e8e-bb2d-03a2f5f56b75 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.816543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.832430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.833118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.833436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.833709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.834414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] RBAC: Adding query filter params (interface=admin, service_id=d8bb712c30594f2190a6384b2998c283, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:13.834720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.836141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.837922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2f76-ea59-4470-9817-67a9e8536ee0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.841315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 483/984] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/endpoints?service_id=d8bb712c30594f2190a6384b2998c283&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:13.846804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.874579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.875529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.876086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.876650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.877504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:13.878345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.879764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:13.896965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 502/985] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:13.897841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:13.902020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:13.949626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f3c4-69a6-44dd-9569-096d9d704f53 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:13.987522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:13.988201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:13.988487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:13.988759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:13.989395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:13.991808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:14.009261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6b027-2fe7-4029-934c-e89ffb0a7dff None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:14.009485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 484/986] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 13:59:14.046325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:14.047078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:14.047425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:14.047766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:14.056361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:14.057896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:14.071135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:14.072078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:14.072978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 503/987] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:14.079798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:14.186346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59755e6-a78c-4b8e-a871-32574fdb488d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:14.208684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:14.223765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:14.224375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:14.224656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:14.224931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:14.225658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:14.225968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:14.227386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17530e2-a787-4cf6-8e76-5798874f139a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:14.240841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 485/988] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:14.246692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:14.249561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:14.352948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229536d6-3621-409d-8309-ef2b485c9cf8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:14.387200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:14.387830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:14.388113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:14.388385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:14.389136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] RBAC: Adding query filter params (role.id=fe5ccc00f6394e199583e3e78ea0c4b5, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=58e245751afb4ba6a3db98ab30e3ddd1) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:14.389486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:14.390975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8782e4-556f-44af-86a2-b0705d38f21f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:14.405258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 504/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:14 2022] GET /identity/v3/role_assignments?user.id=58e245751afb4ba6a3db98ab30e3ddd1&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=fe5ccc00f6394e199583e3e78ea0c4b5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:15.663564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a733b-157b-432e-abba-596207aad408 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:15.664122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a733b-157b-432e-abba-596207aad408 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:15.664122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a733b-157b-432e-abba-596207aad408 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:15.665741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 486/990] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:15.670845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095d03-5a4d-4422-b1e6-87e0cd8305f5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:15.671259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095d03-5a4d-4422-b1e6-87e0cd8305f5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:15.671446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095d03-5a4d-4422-b1e6-87e0cd8305f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:15.689827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-af095d03-5a4d-4422-b1e6-87e0cd8305f5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:15.691027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-af095d03-5a4d-4422-b1e6-87e0cd8305f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:15.752673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:15.761196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 505/991] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:16.030120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a733b-157b-432e-abba-596207aad408 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.137068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a733b-157b-432e-abba-596207aad408 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.164090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6595916-bb0a-4013-8615-ff5e9cbfe92c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.164417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6595916-bb0a-4013-8615-ff5e9cbfe92c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.164646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6595916-bb0a-4013-8615-ff5e9cbfe92c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.166015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 506/992] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:16.170861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.171151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.171431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.172844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0184-3958-4158-a37e-529102024882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.173503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0184-3958-4158-a37e-529102024882 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.173789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0184-3958-4158-a37e-529102024882 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.174067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0184-3958-4158-a37e-529102024882 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.175160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0184-3958-4158-a37e-529102024882 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.176522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0184-3958-4158-a37e-529102024882 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d61c0184-3958-4158-a37e-529102024882 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:16.185344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:16.186311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:16.187146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:16.189817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:16.191548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:16.192089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 487/993] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:16.192682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0184-3958-4158-a37e-529102024882 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.241876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:16.269374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 507/994] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:16.301856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0184-3958-4158-a37e-529102024882 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.335555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.336152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.336429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.336696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.337340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:16.337647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.338991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.348398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 488/995] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:16.349428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.446815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9c463-6803-40c2-a962-d1c3b4c9d50b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.477607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:16.488711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.489356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.489634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.489903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.490792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:16.491092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.492458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.502361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 508/996] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:16.504185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.529357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.611667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa963f7d-a159-4b70-9517-8f241b0eb254 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.621194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:16.630412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfb994-3b58-429c-9121-c6f73caab8d2 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.648468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.649086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.649415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.650049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.650396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] RBAC: Adding query filter params (interface=public, service_id=1d4f4d7119f04d089391e9293908a35e, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:16.650712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.653148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30137-37aa-4325-948f-4713f4485ceb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.658737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 489/997] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/endpoints?service_id=1d4f4d7119f04d089391e9293908a35e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:16.661765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca832c-384e-4401-b32f-28c805497be7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.662168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca832c-384e-4401-b32f-28c805497be7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.662563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca832c-384e-4401-b32f-28c805497be7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.665265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 490/998] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:16.666486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca832c-384e-4401-b32f-28c805497be7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.666812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.667668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.667788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.667995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.668586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.670192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1435da3b-25cb-48c2-9ae5-12b743884b22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:16.679718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:16.681408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:16.682568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 509/999] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:16.683560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.683560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.683560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.700441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:16.701655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:16.750978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:16.768619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 510/1000] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:16.769499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.781190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca832c-384e-4401-b32f-28c805497be7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.820038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.820646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.820931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.821214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.821843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.823389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.830189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 491/1001] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 13:59:16.886087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afef79-2481-495a-a68a-6bde1da84fba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:16.924255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:16.925488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:16.925772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:16.926046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:16.926698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:16.927005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:16.928399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:16.938818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 511/1002] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:16.939653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:16.978733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:17.039206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:17.051377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441419-01ab-4246-aeff-66feef596d64 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:17.087992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:17.088819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:17.089618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:17.089896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:17.090184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:17.090804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:17.091107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:17.092797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:17.103241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 492/1003] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 13:59:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:17.104180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:17.144563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef032f9-5649-42f7-8bf1-66b58250dc1d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:17.177913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:17.178703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:17.178993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:17.179278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:17.179866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:17.181276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:17.191411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:17.192510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:17.193791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 512/1004] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 13:59:17 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:17.198652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:17.210932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:17.214210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb4-4c78-4947-8939-95cf57062392 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:17.250655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:17.251260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:17.251537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:17.251807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:17.252610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:17.254008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:17.277984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 493/1005] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:17.322460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f216-3924-4f4a-8172-e4208cc62d7e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:17.339462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:17.372748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:17.373391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:17.373674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:17.373943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:17.374574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] RBAC: Adding query filter params (name=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:17.374875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:17.376438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccda34-bb2c-4a44-8335-4bd8a6f0aa17 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:17.391013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 513/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:17.392457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:17.500574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b037de-d016-4989-acad-8677a5eb5625 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:17.536097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:17.536709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:17.536992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:17.537318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:17.537929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] RBAC: Adding query filter params (type=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:17.538233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:17.539605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e64e-b5d1-45af-ab23-5537e315d0dc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:17.544366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 494/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:18.989560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0273-632a-4e31-96b0-62fa606de86e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:18.990078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0273-632a-4e31-96b0-62fa606de86e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:18.990381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0273-632a-4e31-96b0-62fa606de86e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:18.992000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 514/1008] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:18.997024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549a96-061b-4559-ab69-fb0762cea8d9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:18.997460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549a96-061b-4559-ab69-fb0762cea8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:18.997627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549a96-061b-4559-ab69-fb0762cea8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.015974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b7549a96-061b-4559-ab69-fb0762cea8d9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:19.017157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b7549a96-061b-4559-ab69-fb0762cea8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:19.035082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:19.086211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 495/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:19.358315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e0273-632a-4e31-96b0-62fa606de86e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.449573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776517-6191-4e80-9cd6-0c93855ff2ad None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.449928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776517-6191-4e80-9cd6-0c93855ff2ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.450188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776517-6191-4e80-9cd6-0c93855ff2ad None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.451755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 496/1010] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:19.457054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.457368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.457620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.462958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e0273-632a-4e31-96b0-62fa606de86e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:19.475397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:19.476567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:19.499409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:19.500034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.500308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.500587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.501168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:19.502606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:19.511769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:19.512965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 13:59:19.514044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:19.517852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 515/1011] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:19.518543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.553423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 497/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:19.563005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:19.637132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34931c3-238a-4f34-b542-64677cfd5888 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:19.670463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:19.671068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.671347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.671620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.672244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:19.672548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:19.673941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fbb26-cb69-444e-895e-ea2cfb68f0cf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:19.683951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 516/1013] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:19.685531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.702895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2944-5bbf-42b2-841a-50a345e1046b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.703192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2944-5bbf-42b2-841a-50a345e1046b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.703609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f2944-5bbf-42b2-841a-50a345e1046b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.705384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 517/1014] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:19.710481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.711258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.711542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.730751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:19.731925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:19.778992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:19.798258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405e023-cad4-45d4-89ff-0facd965f8cb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:19.813276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 518/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:19.821449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.832870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:19.833519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.833802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.834077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.834708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:19.835011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:19.836384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:19.845459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 498/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 13:59:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:19.848950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.854419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:19.929975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e5928-ec39-40dc-ac07-30f8ffc0cb89 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:19.946960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfcd2-1e4e-49c2-a65d-e6366b456a18 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:19.965808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:19.966707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.967194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.967784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.969086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:19.970963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:19.973750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 519/1017] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:19.978963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:19.986786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:19.987424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:19.987711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:19.987990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:19.988659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:19.990037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:20.019632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 499/1018] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:20.082329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:20.084570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:20.086684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff675-6ef4-41d5-b399-39b4ea18edfe None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:20.088401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:20.135221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:20.136237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:20.136515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:20.137020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:20.137478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:20.138939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de5f30-960f-49a5-b322-42dec1242760 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:20.172194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 520/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:19 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:59:20.206494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c334ef3-4fe2-49a3-b5c3-8f536c00ab5f None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:20.247694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:20.248323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:20.248608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:20.248882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:20.249611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:20.251029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739579d6-0250-4f21-b99f-deb4a866dad8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:20.268719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 500/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:20 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:22.312208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0cb-1ffc-4c46-b8b5-620e9bebc309 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.312787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0cb-1ffc-4c46-b8b5-620e9bebc309 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.312787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd0cb-1ffc-4c46-b8b5-620e9bebc309 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.314288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 521/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:22.319816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5b4f-4edd-49b6-8cac-22a73c3460ef None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.320193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5b4f-4edd-49b6-8cac-22a73c3460ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.320353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e5b4f-4edd-49b6-8cac-22a73c3460ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.338705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bc8e5b4f-4edd-49b6-8cac-22a73c3460ef None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:22.339912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bc8e5b4f-4edd-49b6-8cac-22a73c3460ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:22.382380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de419-3543-415d-8e37-960d6851a67c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.382699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de419-3543-415d-8e37-960d6851a67c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.382941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1de419-3543-415d-8e37-960d6851a67c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.385267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 522/1022] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:22.389402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.389825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.390170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.404553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:22.408787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:22.410011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:22.420784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 501/1023] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:22.473624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b37-4a94-428e-b953-aece2a7e7e7d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.474246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b37-4a94-428e-b953-aece2a7e7e7d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.474720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b37-4a94-428e-b953-aece2a7e7e7d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.476241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 502/1024] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:22.479096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 523/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:22.481348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.481630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.481899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.500372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:22.501604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:22.568044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 503/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:22.697142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:22.745088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:22.778814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:22.806278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8e7d-96d9-41a4-a88d-4ed6d63615de None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:22.841781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:22.842350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.842625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.842893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.852858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:22.857606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:22.858578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:22.859425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 524/1027] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:22.860113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd828563-6f33-4b6b-a5a0-54e4bfe76b6a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:22.860187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:22.881907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:22.896911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:22.897561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.897845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.898119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.899212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:22.900645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:22.905341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 504/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:22.905341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:22.960065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825346b4-da5e-4f78-abcc-f2b5a056d63a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:22.994374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:22.995086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:22.995429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:22.995790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:22.996434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:22.997898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.000385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.005455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5faa2-34c4-435d-8dcd-654c5f0b7e23 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:23.008118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:23.009379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:23.010484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 525/1029] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 13:59:22 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:23.011334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.043427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.044020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.044300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.044570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.045241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.045545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.046897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.055156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 505/1030] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:23.056268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.104871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.108521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4b858-c553-420e-8573-e3a060ec31ff None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.142846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.143483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.143762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.144030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.144664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.146103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.154169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50c7df-51fb-4430-b830-397d5938b58d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.173268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 526/1031] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:59:23 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:23.173268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.199516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.200180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.200466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.200740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.201420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] RBAC: Adding query filter params (name=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.201726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.203134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.208552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 506/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:23.214569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.240341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.293718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d01f57-57cd-4158-8515-16c5f6b31540 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.334451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.335372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1857-2e3e-41b2-97ad-6fbd1e3b7854 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.336261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.336694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.337121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.350046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.351646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.351874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:23.368127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:23.369105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:23.370434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:23.370434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:23.370434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:23.370434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 527/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:23.375574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.380086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.380696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.380976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.382257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.382257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] RBAC: Adding query filter params (type=image) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.382257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.383540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.388731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 507/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:23.394594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.490064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1c003-8e07-44db-aa3a-1ebf7c2d5774 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.500598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.506580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cddaff-932e-4e9d-aef7-d0b4473b7104 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.527524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.528277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.528390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.528670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.529365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.529674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.531055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.547573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 528/1035] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:23.548616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.550808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.551418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.551692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.551970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.552663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] RBAC: Adding query filter params (interface=public, service_id=6c8f8f1299824ca7957c478a15c9ef11, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.552975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.554390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.560018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 508/1036] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/endpoints?service_id=6c8f8f1299824ca7957c478a15c9ef11&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:23.565593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.609817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.655758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d728f8-16b7-487c-8eee-18bd4c1924de None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.667345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c4b14-3bc2-4219-a9c3-96f8948a2253 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.691716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.692506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.692792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.693164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.700429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.700973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.701872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.701872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.702095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.702170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.702717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.704058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.711349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 509/1037] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:23.714653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:23.715638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:23.717171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 529/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:23.722267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.839666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae3be-2c4f-41aa-8b8e-6aa2801e3326 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:23.848679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:23.879422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:23.880032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:23.880315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:23.880591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:23.881352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:23.881664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:23.883724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:23.902728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 510/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:23.908319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:23.938910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:24.017100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb96def-6aa6-486c-8bc2-68c334381702 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:24.052233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:24.052847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:24.053129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:24.053433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:24.128834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:24.130332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:24.156617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:24.237359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 530/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:24.240693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:24.339270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761254f0-e4e6-477a-9278-0e36aa55215d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:24.374443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:24.375075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:24.375357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:24.375634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:24.385651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:24.387095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:24.401764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:24.402726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:24.403624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:24.403624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:24.403624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:24.403624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 511/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:24.410028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:24.512461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425e9f-2e1f-4821-a50d-5c74b48d9e2d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:24.540287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:24.549744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:24.550355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:24.550638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:24.550914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:24.551554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:24.551862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:24.553264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:24.568895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 531/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:24.570168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:24.590429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:24.677668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5b0d-fe9a-45b3-832e-2f18a329fac0 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:24.710725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:24.711341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:24.711619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:24.711892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:24.718547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:24.719971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:24.731583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:24.732632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:24.734026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:24.734767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 512/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:24.738484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:24.845206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd51048-0c2f-4288-867c-b4d43eb9ee0b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:24.879687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:24.880300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:24.880584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:24.880860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:24.881598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:24.881908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:24.883345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b928980-c3ed-4e7c-b237-2c21b031473c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:24.900840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 532/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:24.902060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:24.983029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:25.007930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917a36e-ee27-4bd7-b9eb-341908c8eee4 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:25.043935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:25.044457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.044738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.045011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.045768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] RBAC: Adding query filter params (role.id=fe5ccc00f6394e199583e3e78ea0c4b5, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:25.046076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:25.047504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dfa65-083e-4256-affc-57c04b562708 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:25.057405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 513/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:24 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=fe5ccc00f6394e199583e3e78ea0c4b5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:25.400523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1dd1-2572-4613-ad6d-362cee921031 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.400715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1dd1-2572-4613-ad6d-362cee921031 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.401029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac1dd1-2572-4613-ad6d-362cee921031 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.402443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 533/1046] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:25.407793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce3ef-accf-45e7-9ecc-cc7d105e68d7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.408240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce3ef-accf-45e7-9ecc-cc7d105e68d7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.408338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce3ef-accf-45e7-9ecc-cc7d105e68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.426664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-959ce3ef-accf-45e7-9ecc-cc7d105e68d7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:25.427830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-959ce3ef-accf-45e7-9ecc-cc7d105e68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:25.498041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 514/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:25.770031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1dd1-2572-4613-ad6d-362cee921031 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:25.832359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:25.884805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac1dd1-2572-4613-ad6d-362cee921031 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:25.884997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2ac20-a327-4485-9fa2-5cf4de8462fd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.885248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2ac20-a327-4485-9fa2-5cf4de8462fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.885468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2ac20-a327-4485-9fa2-5cf4de8462fd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.886923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 515/1048] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:25.892015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.892314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.892587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.912425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:25.913676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:25.924051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:25.925255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:25.925542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:25.925821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:25.937168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:25.942495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:25.943677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:25.944531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 534/1049] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:25.949587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:25.982998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:25.990969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 516/1050] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:26.053022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b4fbe-1612-4225-a126-ba91c5b24299 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.062437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.087986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.088589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.088868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.089140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.089840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:26.090149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.091582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.099828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 535/1051] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:26.105519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.211233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86934-87d5-4b87-96ba-bd8dd014dcc1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.247785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.248694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.249183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.249663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] PATH_INFO: `/v3/users/48d2d256420a4deebd074f0ba21f4bf9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.263817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] RBAC: Authorizing `identity:get_user(user_id=48d2d256420a4deebd074f0ba21f4bf9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.265573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.267725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 517/1052] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/users/48d2d256420a4deebd074f0ba21f4bf9 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:26.269411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.272876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.335843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.379145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aac47c-267f-4983-9f0d-da451874f6a9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.384012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b89eb-dc3f-4093-a2c5-c2beca3cfb0a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.415371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.416097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.416364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.416642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] PATH_INFO: `/v3/services/image` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.417262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.418636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.419185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.419748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.420026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.420410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:26.427864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:26.429035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 13:59:26.430061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:26.433549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 536/1053] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:26.436709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.473195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.505143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.506798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.541802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056eff5-a377-4f87-9cfe-097de678f45d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.567191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.581572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.582391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.582816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.583279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.584047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:26.584947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.586898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.593895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 537/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:26.599666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.616710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 518/1055] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:26.617931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.698344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.702013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d71e69-9aa2-4616-a445-5431102841a4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.733182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac666-0ca1-4744-b958-2139c9a5f167 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.737530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.738151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.738432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.738704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.739338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:26.739641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.741298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.746388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 538/1056] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:26.751959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.777772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.778880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.779168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.779738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.781595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.784353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.789743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 519/1057] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:26.792430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:26.820865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:26.862034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b7f33-d1be-4b64-a5cb-c16fd3c01bc3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.898552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec12f-9616-455f-9149-3cf8ad364087 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:26.899038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.899650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.900052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.900332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.901339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.902604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779949-d734-4ac8-90a5-32a1f4adcb60 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.924407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 539/1058] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 13:59:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:59:26.941847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:26.942474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:26.942754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:26.943025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:26.943766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=e73ffd2365a444aaa46628e905a2712b, user.id=48d2d256420a4deebd074f0ba21f4bf9) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:26.944076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:26.945587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11870bbe-a532-47aa-9c68-3809a04df905 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:26.961553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 520/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:26 2022] GET /identity/v3/role_assignments?user.id=48d2d256420a4deebd074f0ba21f4bf9&scope.project.id=e73ffd2365a444aaa46628e905a2712b&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:27.195668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f746b6-7d5a-424e-96d1-b6fb970b9bd6 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:27.199927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f746b6-7d5a-424e-96d1-b6fb970b9bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:27.200276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f746b6-7d5a-424e-96d1-b6fb970b9bd6 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:27.202007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 540/1060] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:27.208045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:27.208331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:27.208611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:27.226398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:27.227571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:27.296629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 521/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:27.561771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f746b6-7d5a-424e-96d1-b6fb970b9bd6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:27.581805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:27.669198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f746b6-7d5a-424e-96d1-b6fb970b9bd6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:27.704188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:27.704822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:27.705104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:27.705449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:27.715516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:27.720234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:27.725384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:27.726397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 541/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:27.727753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:27.746624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:27.837158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282672b-c19e-461a-a120-d8d8168c158f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:27.875626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:27.876231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:27.876508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:27.876776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:27.877470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:27.877770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:27.879116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:27.889404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 522/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:27.892630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:27.973131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:27.997176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92f4f3-0405-4bcb-88e8-3200b0d61cd1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.030695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.031313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.031593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.031866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.042854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.044321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:28.060181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:28.061113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:28.067288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:28.067288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:28.067288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:28.067288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 542/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:28.069049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.147322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:28.171788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077785e-da0b-4325-bd1b-5e5fd33750a3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.206071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.206681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.206967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.207244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.207885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:28.208189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.209590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.221996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 523/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:28.228426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.334588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381469-852f-449e-ab5d-25b339164ee1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.362632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:28.370104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.370726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.371007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.371279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.379237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.380689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:28.391542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:28.392473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:28.394024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 543/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:28.399036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.498297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f83b3-8318-410f-9908-826414d3ffaf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.532279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.533259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.534312 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.534787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.535703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:28.536211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.537873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.545969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:28.556843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 524/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:28.562566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.662588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea334-9050-416a-bb09-37ca565a4d72 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.696160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.696793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.697072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.697374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.708706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.710178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:28.724222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:28.725179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:28.731116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:28.731116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:28.731116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:28.731116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 544/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:28.731354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.838854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868e368-8527-4506-9946-3e18051d2b49 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:28.872640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:28.873258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:28.873562 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:28.873832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:28.874462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:28.874761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:28.876115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:28.887794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 525/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:28.893830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:28.936612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:28.994156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ecf53-bfe5-4697-871a-c00e089c8486 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.033958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.034616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.034893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.035163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.042751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:29.044210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-06e6b219-5d9e-4a3e-b608-1d002e81d0d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:29.056256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:29.057169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:29.058200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:29.061546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 545/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:29.063065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.119470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.130828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb4a2-2674-4ec9-a4b2-a01b9d1d9f5b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.131115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb4a2-2674-4ec9-a4b2-a01b9d1d9f5b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.131620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bb4a2-2674-4ec9-a4b2-a01b9d1d9f5b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.132828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 546/1071] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 13:59:29.133907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823cca3-1595-4831-94a7-af667009f22a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.134247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823cca3-1595-4831-94a7-af667009f22a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.134525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823cca3-1595-4831-94a7-af667009f22a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.135792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 547/1072] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:29.138047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.138343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.138628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.156348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:29.157558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:29.165687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bba07-ac6b-42c4-baa7-0b4188eff058 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.199221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.199828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.200113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.200386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.201068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:29.201404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:29.202827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486bff5-6405-41e7-92a1-1a43fa9cfc1d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:29.214722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 526/1073] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:29.214722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.214722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.214722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.225140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 548/1074] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:29.225977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.238011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:29.240068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:29.263798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.314743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 527/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:29.338767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f5b73-fedc-4f07-8366-3a80ad6565d3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.373657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.374317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.374593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.374864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/fe5ccc00f6394e199583e3e78ea0c4b5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.377036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=0984655bd84440f0b4baf516e7be88b9, role_id=fe5ccc00f6394e199583e3e78ea0c4b5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:29.378536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:29.391728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 549/1076] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:59:29 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/0984655bd84440f0b4baf516e7be88b9/roles/fe5ccc00f6394e199583e3e78ea0c4b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:59:29.521573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.574414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.583960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.630032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bc149-65af-4c6b-9ff2-a125274f854d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.665936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.666573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.666858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.667124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.678627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:29.683440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:29.684584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:29.685604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 528/1077] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:29.691004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.697352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.707794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a077a3-3e18-47a9-bebd-51cdbf73657c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.743808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.744418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.744697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.744971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.813219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f43ea-975f-449f-a529-21dd942dc691 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:29.819696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:29.821246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:29.821687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.854544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:29.855164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:29.855449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:29.855727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:29.856401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:29.856706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:29.858337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:29.869251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 529/1078] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:29.875069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.926899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:29.939053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 550/1079] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:29.944759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:29.993268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd3a5-17dc-49d7-8ae6-c9002dbdd552 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:30.032057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2034-5743-43de-859a-156e6699789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:30.032750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2034-5743-43de-859a-156e6699789e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:30.033269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2034-5743-43de-859a-156e6699789e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:30.033477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f2034-5743-43de-859a-156e6699789e None admin] PATH_INFO: `/v3/users/48d2d256420a4deebd074f0ba21f4bf9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:30.034684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f2034-5743-43de-859a-156e6699789e None admin] RBAC: Authorizing `identity:get_user(user_id=48d2d256420a4deebd074f0ba21f4bf9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:30.036110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f2034-5743-43de-859a-156e6699789e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:30.042368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 530/1080] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/users/48d2d256420a4deebd074f0ba21f4bf9 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:30.043315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2034-5743-43de-859a-156e6699789e None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:30.058370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398ed9-0477-4d68-a4ec-d673719f75d1 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:30.084125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:30.099603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:30.100245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:30.100531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:30.100798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:30.111443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:30.113503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:30.130442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:30.131453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:30.132356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:30.132356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:30.132356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:30.132356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 551/1081] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:30.137756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:30.162324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f2034-5743-43de-859a-156e6699789e None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:30.186469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:30.197071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:30.197744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:30.198021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:30.198299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:30.199392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:30.200838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:30.202481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 531/1082] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:30 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:30.208430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:30.244344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76a8a7-9432-4be1-8855-de9d857dd2b7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:30.278862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:30.279475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:30.279754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:30.280020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:30.280658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:30.280972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:30.282389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731024b-aa34-4673-861c-f2c976ad8d01 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:30.295038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 552/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:30.327117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3da9-eb0d-4092-8d70-7db7defe75c3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:30.331346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:30.373363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:30.374038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:30.374316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:30.374588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b/users/48d2d256420a4deebd074f0ba21f4bf9/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:30.376543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] RBAC: Authorizing `identity:create_grant(project_id=e73ffd2365a444aaa46628e905a2712b, user_id=48d2d256420a4deebd074f0ba21f4bf9, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:30.378604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e9e2-cc6e-4d50-9e19-2b91a955191d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:30.394490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 532/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:59:30 2022] PUT /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b/users/48d2d256420a4deebd074f0ba21f4bf9/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 13:59:31.589986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440500-d625-479e-9327-dd97259d3cba None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:31.590550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440500-d625-479e-9327-dd97259d3cba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:31.590550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440500-d625-479e-9327-dd97259d3cba None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:31.591869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 553/1085] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:31.596939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:31.597383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:31.597520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:31.615272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:31.616711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:31.682101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 533/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:31.950000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440500-d625-479e-9327-dd97259d3cba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.047847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440500-d625-479e-9327-dd97259d3cba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.050172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:32.081530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.082157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.082435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.082707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.092481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:32.097902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:32.099079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:32.100009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 554/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 13:59:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:32.105117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.195894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:32.203044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff29e4-767b-4050-b4af-dc1acc5af8ad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.236763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.237402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.237688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.237963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.238622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:32.238926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:32.240281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:32.248139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 534/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:32.254160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.350715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32bd4-91b7-4050-a836-e27084358d8a None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.385798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.386429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.386706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.386977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.396957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:32.398434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b69e5c92-4dee-4e35-bb0a-183321cd476d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:32.412869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:32.413992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:32.414907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:32.414907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:32.414907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:32.414907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 555/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:32.419790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.524955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6352-e5f4-420b-bda4-e8e47cbf477c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.547956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb245ce-a3ed-4073-bbea-798f8a419d3c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.548250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb245ce-a3ed-4073-bbea-798f8a419d3c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.548532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb245ce-a3ed-4073-bbea-798f8a419d3c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.550554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 556/1090] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:32.555367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.555643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.555923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.558413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.559008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.559284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.559560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.560187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:32.560486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:32.561870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:32.577998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 535/1091] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:32.578163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:32.578163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:32.578950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.585788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:32.597146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:32.642231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 557/1092] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:32.678347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a19902-6b01-46db-a247-e87fc0e3ca3d None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.710309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.710919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.711195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.711469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.718191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:32.719599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 13:59:32.731938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:32.733057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:32.734273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 536/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:32.738838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.841340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4aada-3c12-4ef6-be7a-731efbc09c81 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:32.874265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:32.874866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:32.875144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:32.875418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:32.876145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:32.876449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:32.877955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:32.895657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 558/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:32.901216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.912370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:32.916407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:32.980025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.002974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e329-7f4c-438a-bfd5-0b461c647fa5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.008235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21254d-c094-4625-8978-40f2e6e1c58b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.035997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.036586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.036910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.037134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.041974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.042599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.042883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.043160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.053194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:33.058243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:33.059266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:33.060148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 559/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:33.066913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.105350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.106814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.130412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.168512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0a1f2-7906-4324-a45e-a71fb365723f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.182545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.201430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.202019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.202300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.202568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.203225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:33.203525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.204877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.206909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 537/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:33.212585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.218282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 560/1097] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.219491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.310898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2c74f-13d1-4319-8b54-7c8a51c40c0c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.318321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117fcf9-79cd-4a23-acb2-995e930c16f7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.343080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.345047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.345653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.345974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.346248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.351914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.352538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.352812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.353081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] PATH_INFO: `/v3/users/48d2d256420a4deebd074f0ba21f4bf9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.354220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] RBAC: Authorizing `identity:get_user(user_id=48d2d256420a4deebd074f0ba21f4bf9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.355638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.356052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.357210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 561/1098] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/users/48d2d256420a4deebd074f0ba21f4bf9 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.357492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.362960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 13:59:33.372010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:33.373035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 13:59:33.374621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 13:59:33.374621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 13:59:33.374621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:33.374621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 538/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:33.379084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.406900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.463469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f821f-2d30-42ef-a4d9-fb46d1508edc None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.478912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2917b4-4477-4344-b4b8-3c3678693e71 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.497071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.497703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.497985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.498259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.512919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.513539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.513817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.514090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.514721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:33.515022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.516385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.527915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 539/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.533519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.557130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.565615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.567001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.619261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.633115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca7a1-4f7e-4402-b756-e8dc0615550c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.665714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.666331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.666609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.666880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.667581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 562/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 05 13:59:33.673513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.673850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.675814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 13:59:33.687787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:33.688786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 540/1102] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 13:59:33.695277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.764806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.772174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f4f9-f367-48db-a096-0aacc9c1b430 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.793878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853cc49-ac7e-4b04-a7ae-12722ac73196 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.806609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.807237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.807631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.807905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.809009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.810478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.812141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 563/1103] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.818848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.828161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.828765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.829051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.829354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.830043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:33.830381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.831803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.842924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 541/1104] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.849343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:33.859510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:33.915513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c001f-d713-4c16-8fef-b6fa685a281b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.946478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838ea2-3cfe-4af0-8b82-3a897714a29a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:33.948939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.949576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.949858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.950132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.950850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=e73ffd2365a444aaa46628e905a2712b, user.id=48d2d256420a4deebd074f0ba21f4bf9) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:33.951160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.952592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d017-4307-4f9e-b802-076b13a5102c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.958418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 564/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/role_assignments?user.id=48d2d256420a4deebd074f0ba21f4bf9&scope.project.id=e73ffd2365a444aaa46628e905a2712b&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:33.980458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:33.981077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:33.981390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:33.981666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:33.982415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] RBAC: Adding query filter params (role.id=fe5ccc00f6394e199583e3e78ea0c4b5, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=0984655bd84440f0b4baf516e7be88b9) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:33.982721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:33.984181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9a01d-fb88-4aaf-be2e-5d485a038c1b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:33.991653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 542/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:33 2022] GET /identity/v3/role_assignments?user.id=0984655bd84440f0b4baf516e7be88b9&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=fe5ccc00f6394e199583e3e78ea0c4b5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:36.127632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d4af-ec78-41b8-8b1d-47988673ae2d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:36.128156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d4af-ec78-41b8-8b1d-47988673ae2d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:36.128156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d4af-ec78-41b8-8b1d-47988673ae2d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:36.129467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 565/1107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:36.134677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:36.135098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:36.135233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:36.152888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:36.154095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:36.217575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 543/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:36.487055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d4af-ec78-41b8-8b1d-47988673ae2d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:36.513776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:36.586074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d4af-ec78-41b8-8b1d-47988673ae2d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:36.618281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:36.618891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:36.619168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:36.619439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:36.620515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:36.621965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0daf1c-d178-4125-b3c9-4f2167cb52f7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:36.623503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 566/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:36.629210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:36.631374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:36.724811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4cc29-0baf-48cd-a61d-0d692e51c209 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:36.756925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:36.757490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:36.757773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:36.758045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:36.758687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:36.760105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1d541-048e-42ed-a672-064069f9962c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:36.781705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 544/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:59:36 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:38.924978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d85e5-dd5e-4cba-bac5-f93dd3d991a9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:38.925554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d85e5-dd5e-4cba-bac5-f93dd3d991a9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:38.925554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d85e5-dd5e-4cba-bac5-f93dd3d991a9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:38.926888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 567/1111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:38.932042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:38.932419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:38.932601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:38.950319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:38.951506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:39.002731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:39.016606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 545/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 13:59:39.281124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d85e5-dd5e-4cba-bac5-f93dd3d991a9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:39.371941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:39.380164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d85e5-dd5e-4cba-bac5-f93dd3d991a9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:39.412837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:39.413479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:39.413762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:39.414038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] PATH_INFO: `/v3/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:39.415412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] RBAC: Authorizing `identity:get_role(role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:39.416782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:39.418129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 568/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:39 2022] GET /identity/v3/roles/a539e6faf0104fb0a48571ee19579d1e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:39.424440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:39.524588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bae94-6e7c-4fe3-8a9f-44dad098b03a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:39.557911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:39.558469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:39.558749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:39.559024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] PATH_INFO: `/v3/users/9f82047818d344d1bc05d6049742570f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:39.572106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] RBAC: Authorizing `identity:get_user(user_id=9f82047818d344d1bc05d6049742570f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:39.573562 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:39.575134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 546/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:39 2022] GET /identity/v3/users/9f82047818d344d1bc05d6049742570f => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:39.581068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:39.677933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2687-ea05-4d25-89d8-043c5c073efa None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:39.709959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:39.710554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:39.710837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:39.711112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:39.740781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:39.779512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:39.780988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:39.876551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 569/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:39.882434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:39.927237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:39.977364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658193-725d-47cf-9249-37d93c5a6cac None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:40.009648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:40.010258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:40.010537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:40.010809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:40.011891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:40.013330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950983-375a-4088-88f2-2ef82261eacc None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:40.014930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 547/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:39 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:40.020945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:40.078159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:40.115064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1a43b-eb86-4f3e-9ac6-71ac8b720153 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:40.146560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:40.147087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:40.147360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:40.147626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:40.148333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=e73ffd2365a444aaa46628e905a2712b, user.id=9f82047818d344d1bc05d6049742570f) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:40.148634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:40.150080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba48dba-03b1-4659-954a-24b004ec9aa9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:40.155147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 570/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:40 2022] GET /identity/v3/role_assignments?user.id=9f82047818d344d1bc05d6049742570f&scope.project.id=e73ffd2365a444aaa46628e905a2712b&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 13:59:42.278010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde397-97c3-4c40-a523-193af918c8f4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:42.278566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde397-97c3-4c40-a523-193af918c8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:42.278566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde397-97c3-4c40-a523-193af918c8f4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:42.279892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 548/1118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:42.284996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:42.285448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:42.285586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:42.303341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:42.304521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:42.369321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 571/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:42.638777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde397-97c3-4c40-a523-193af918c8f4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:42.734277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde397-97c3-4c40-a523-193af918c8f4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:42.748073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:42.770611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:42.771227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:42.771500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:42.771796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] PATH_INFO: `/v3/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:42.774146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] RBAC: Authorizing `identity:get_role(role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:42.776586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:42.778871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 549/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:42 2022] GET /identity/v3/roles/a539e6faf0104fb0a48571ee19579d1e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:42.785197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:42.837939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:42.880519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bdfea-2825-4d0d-8b42-2ed86d70c606 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:42.912817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:42.913421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:42.913705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:42.913981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] PATH_INFO: `/v3/users/9f82047818d344d1bc05d6049742570f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:42.915091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] RBAC: Authorizing `identity:get_user(user_id=9f82047818d344d1bc05d6049742570f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:42.916516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:42.918109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 572/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:42 2022] GET /identity/v3/users/9f82047818d344d1bc05d6049742570f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:42.923786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:43.017943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d4ce-84fb-43c6-ade2-2782c7fe777a None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:43.050728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:43.051323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:43.051597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:43.051863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:43.052938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:43.054379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304be9-47ea-43bd-ae13-7f73b1117826 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:43.055951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 550/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:42 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:43.061533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:43.157017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8961-e3bf-4664-8844-c715f0232d44 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:43.180000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:43.190461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:43.191102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:43.191385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:43.191662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b/users/9f82047818d344d1bc05d6049742570f/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:43.193801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e73ffd2365a444aaa46628e905a2712b, user_id=9f82047818d344d1bc05d6049742570f, role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:43.195238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed4270-04dc-4d16-93bf-6a2e64b415e1 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:43.207559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 573/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:59:43 2022] PUT /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b/users/9f82047818d344d1bc05d6049742570f/roles/a539e6faf0104fb0a48571ee19579d1e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 13:59:45.313625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83340-350e-4493-a10b-d363d0eab020 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:45.314153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83340-350e-4493-a10b-d363d0eab020 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:45.314153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba83340-350e-4493-a10b-d363d0eab020 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:45.316003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 551/1124] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:45.321276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:45.321709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:45.321833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:45.342045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:45.343252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:45.407846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 574/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:45.672860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba83340-350e-4493-a10b-d363d0eab020 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:45.721537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:45.770495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba83340-350e-4493-a10b-d363d0eab020 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:45.803713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:45.804325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:45.804602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:45.804872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] PATH_INFO: `/v3/roles/a539e6faf0104fb0a48571ee19579d1e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:45.806246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] RBAC: Authorizing `identity:get_role(role_id=a539e6faf0104fb0a48571ee19579d1e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:45.807593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:45.808897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 552/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:45 2022] GET /identity/v3/roles/a539e6faf0104fb0a48571ee19579d1e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:45.814590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:45.910363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd052b-fc2e-427d-b1e5-58c0efd7828c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:45.929211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:45.949461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:45.950083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:45.950363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:45.950635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] PATH_INFO: `/v3/users/9f82047818d344d1bc05d6049742570f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:45.951726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] RBAC: Authorizing `identity:get_user(user_id=9f82047818d344d1bc05d6049742570f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:45.953142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:45.954717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 575/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:45 2022] GET /identity/v3/users/9f82047818d344d1bc05d6049742570f => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:45.960443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:46.055290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57be58-bddc-4d96-89be-b35d169132a5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:46.071544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:46.087766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:46.088345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:46.088620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:46.088886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:46.152621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:46.154062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:46.246962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 553/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:46.252790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:46.347311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc523-65a6-4bae-9e90-ac1c28724ffe None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:46.380113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:46.380732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:46.381013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:46.381322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] PATH_INFO: `/v3/projects/e73ffd2365a444aaa46628e905a2712b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:46.382416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] RBAC: Authorizing `identity:get_project(project_id=e73ffd2365a444aaa46628e905a2712b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:46.383847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891e7f-2be3-4e0c-90f6-94b016b55f88 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:46.385490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 576/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:46 2022] GET /identity/v3/projects/e73ffd2365a444aaa46628e905a2712b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:46.391535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:46.408878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:46.486284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc58cd2-2f60-4ea8-b4b8-71029d256be5 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:46.519367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:46.519890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:46.520168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:46.520440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:46.521153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] RBAC: Adding query filter params (role.id=a539e6faf0104fb0a48571ee19579d1e, scope.project.id=e73ffd2365a444aaa46628e905a2712b, user.id=9f82047818d344d1bc05d6049742570f) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:46.521490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:46.522901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d47cd-e65c-468d-8887-192f9c4823e9 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:46.528382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 554/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:46 2022] GET /identity/v3/role_assignments?user.id=9f82047818d344d1bc05d6049742570f&scope.project.id=e73ffd2365a444aaa46628e905a2712b&role.id=a539e6faf0104fb0a48571ee19579d1e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:48.656843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4e5c-c65d-4cf2-8e9a-d819ffa38cdd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:48.657442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4e5c-c65d-4cf2-8e9a-d819ffa38cdd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:48.657442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a4e5c-c65d-4cf2-8e9a-d819ffa38cdd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:48.658754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 577/1131] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:48.663982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:48.664398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:48.664534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:48.682667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:48.683839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:48.747050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 555/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:49.013297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a4e5c-c65d-4cf2-8e9a-d819ffa38cdd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:49.063533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:49.111659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a4e5c-c65d-4cf2-8e9a-d819ffa38cdd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:49.144042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:49.144658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:49.144939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:49.145211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:49.146329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:49.147755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6dc0-9954-4ff1-8c37-0186dfffbb44 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:49.149335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 578/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:49.155080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:49.169213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:49.250426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ba88f-429b-4df5-b5a9-6cb327fd1ef6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:49.282689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:49.283218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:49.283496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:49.283767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:49.284965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:49.286404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1d25f-5f04-44eb-bd06-d9f67720a29c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:49.310946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 556/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 13:59:49 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 13:59:51.443165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1943-57e2-403b-8a26-b6298e32bca1 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:51.443723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1943-57e2-403b-8a26-b6298e32bca1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:51.443723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1943-57e2-403b-8a26-b6298e32bca1 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:51.445035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 579/1135] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:51.452059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:51.452467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:51.452615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:51.471504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:51.472679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:51.528843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:51.538141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 557/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:51.806827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b1943-57e2-403b-8a26-b6298e32bca1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:51.904325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b1943-57e2-403b-8a26-b6298e32bca1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:51.921148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:51.937950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:51.938564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:51.938844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:51.939117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:51.940236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:51.941694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2e21-98c5-4e1b-9f88-6585e3665b02 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:51.943233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 580/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 13:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:51.948822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:52.041684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1accd3d-566f-48c6-b259-1ff9c7ba3536 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:52.074281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:52.074859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:52.075180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:52.075457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:52.076101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:52.077589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77241a-cdda-440a-9e13-1ce61a554d4c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:52.098053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 558/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 13:59:51 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 13:59:54.240722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e77dd-2d8d-4942-925c-9862bbc11023 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:54.241266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e77dd-2d8d-4942-925c-9862bbc11023 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:54.241694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e77dd-2d8d-4942-925c-9862bbc11023 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:54.243916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 581/1139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:54.249194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:54.249617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:54.249774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:54.267831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:54.269695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:54.312572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:54.334111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 559/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:54.607211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e77dd-2d8d-4942-925c-9862bbc11023 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:54.704753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e77dd-2d8d-4942-925c-9862bbc11023 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:54.736365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:54.737522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:54.737803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:54.738076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:54.747954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:54.753257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:54.754362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:54.755216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 582/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:54.760172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:54.859741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40cdc-5d94-4575-a31a-80df0f287efe None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:54.892400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:54.892989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:54.893290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:54.893565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:54.894212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:54.894511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:54.895854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:54.903526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 560/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:54.910001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:54.955852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:55.007599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd7b2-dcf5-4a0a-ac52-a2e51c7aef34 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:55.040004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:55.040615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:55.040894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:55.041169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] PATH_INFO: `/v3/users/8f3d5eb3cbf94b04928238eacced5929` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:55.054338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] RBAC: Authorizing `identity:get_user(user_id=8f3d5eb3cbf94b04928238eacced5929)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:55.055762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:55.057332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 583/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:54 2022] GET /identity/v3/users/8f3d5eb3cbf94b04928238eacced5929 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:55.062948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:55.103912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:55.157014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd46a9-411d-49ec-a1b9-82b58d782fd1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:55.189251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:55.189841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:55.190143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:55.190411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:55.254507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:55.255947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:55.295903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:55.350848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 561/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 13:59:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 13:59:55.356745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:55.454426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146e58a-3dc5-40d7-a534-91f4e9487108 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:55.456629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:55.487879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:55.488517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:55.488801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:55.489077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] PATH_INFO: `/v3/projects/c376bb60db2f483183ad4efd1d975ebc` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:55.490505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] RBAC: Authorizing `identity:get_project(project_id=c376bb60db2f483183ad4efd1d975ebc)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:55.491939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada7b5-5302-40a1-b365-11884f64fcea None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:55.493617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 584/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:55 2022] GET /identity/v3/projects/c376bb60db2f483183ad4efd1d975ebc => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:55.499683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:55.593438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f634f-1350-4f91-9b98-cf053ab38947 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:55.626326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:55.626905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:55.627179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:55.627491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:55.628197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=c376bb60db2f483183ad4efd1d975ebc, user.id=8f3d5eb3cbf94b04928238eacced5929) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:55.628502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:55.629944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df5671-5c5e-4bb8-801e-774d5eef16c4 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:55.634999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 562/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 13:59:55 2022] GET /identity/v3/role_assignments?user.id=8f3d5eb3cbf94b04928238eacced5929&scope.project.id=c376bb60db2f483183ad4efd1d975ebc&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:57.708596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118643d-9095-4b79-bde9-84a172de4da8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:57.709142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118643d-9095-4b79-bde9-84a172de4da8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:57.709142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118643d-9095-4b79-bde9-84a172de4da8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:57.710518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 585/1147] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 13:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 13:59:57.715888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:57.716287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:57.716439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:57.730206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:57.735741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 13:59:57.737439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 13:59:57.803295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 563/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 13:59:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 13:59:58.068169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118643d-9095-4b79-bde9-84a172de4da8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:58.166147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118643d-9095-4b79-bde9-84a172de4da8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:58.198874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:58.199488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:58.199772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:58.200044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:58.210391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 13:59:58.215097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 13:59:58.216178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 13:59:58.217406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 586/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 13:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 13:59:58.222528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:58.315878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e1ea2-e776-47dc-aa50-4346374ae3a3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:58.349543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:58.350081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:58.350361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:58.350635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:58.351301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 13:59:58.351601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:58.352958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:58.355283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:58.362273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 564/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 13:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:58.368229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:58.399393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:58.465150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1d81a-8d01-4cd8-a3fc-a23892bf9200 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:58.498944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:58.499566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:58.499849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:58.500121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] PATH_INFO: `/v3/users/8f3d5eb3cbf94b04928238eacced5929` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:58.501217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] RBAC: Authorizing `identity:get_user(user_id=8f3d5eb3cbf94b04928238eacced5929)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:58.503292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:58.504850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 587/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 13:59:58 2022] GET /identity/v3/users/8f3d5eb3cbf94b04928238eacced5929 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:58.510510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:58.609070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1c1-c34b-4064-9219-28aa10ee83f7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:58.641156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:58.641791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:58.642072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:58.642343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] PATH_INFO: `/v3/projects/c376bb60db2f483183ad4efd1d975ebc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:58.643439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] RBAC: Authorizing `identity:get_project(project_id=c376bb60db2f483183ad4efd1d975ebc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:58.644844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6b8a-dc43-4086-a0be-b019f0a07cbe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:58.646476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 565/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 13:59:58 2022] GET /identity/v3/projects/c376bb60db2f483183ad4efd1d975ebc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 13:59:58.652493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 13:59:58.747795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 13:59:58.750765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93178d-f3a5-4d5c-920d-41877f8925a3 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 13:59:58.783430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 13:59:58.784589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 13:59:58.784872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 13:59:58.785151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] PATH_INFO: `/v3/projects/c376bb60db2f483183ad4efd1d975ebc/users/8f3d5eb3cbf94b04928238eacced5929/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 13:59:58.787071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=c376bb60db2f483183ad4efd1d975ebc, user_id=8f3d5eb3cbf94b04928238eacced5929, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 13:59:58.788497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836eb0b-6960-4994-9a6f-acf835a38f8c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 13:59:58.802139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 588/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 13:59:58 2022] PUT /identity/v3/projects/c376bb60db2f483183ad4efd1d975ebc/users/8f3d5eb3cbf94b04928238eacced5929/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:00:00.886918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8c41-24ad-4040-8ca9-d78889e3cb88 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:00.887423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8c41-24ad-4040-8ca9-d78889e3cb88 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:00.887538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8c41-24ad-4040-8ca9-d78889e3cb88 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:00.888795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 566/1154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:00.894606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:00.895027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:00.895166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:00.912931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:00.914139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:00.977404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 589/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:01.246600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8c41-24ad-4040-8ca9-d78889e3cb88 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:01.310932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:01.346728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8c41-24ad-4040-8ca9-d78889e3cb88 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:01.378698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:01.379305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:01.379584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:01.379854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:01.389525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:00:01.394759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:00:01.395889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:00:01.396919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 567/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:00:01.401786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:01.491316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:01.501166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd02c94-481f-4d28-9009-b13cd9972a2a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:01.534409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:01.535004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:01.535286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:01.535561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:01.536219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:01.536523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:01.537920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:01.545694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 590/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:01.552187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:01.648203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc8cb2-f5bb-43a8-8ff9-b9968c8f5106 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:01.672404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:01.681440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:01.682050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:01.682329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:01.682676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] PATH_INFO: `/v3/users/8f3d5eb3cbf94b04928238eacced5929` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:01.683775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] RBAC: Authorizing `identity:get_user(user_id=8f3d5eb3cbf94b04928238eacced5929)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:01.685210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:01.686781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 568/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 14:00:01 2022] GET /identity/v3/users/8f3d5eb3cbf94b04928238eacced5929 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:01.692982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:01.789393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28b383-dc35-43bd-a77e-4d2c89424ed8 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:01.821883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:01.822484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:01.822766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:01.823040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:01.843751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:01.887609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:01.889042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:01.981346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 591/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:00:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:00:01.987797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:02.083551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d42b87-2f38-4def-be81-8764a5cb2d82 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:02.115777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:02.116380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:02.116655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:02.116923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] PATH_INFO: `/v3/projects/c376bb60db2f483183ad4efd1d975ebc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:02.118033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] RBAC: Authorizing `identity:get_project(project_id=c376bb60db2f483183ad4efd1d975ebc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:02.119435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a5a3f-6c38-4439-9d9d-202f2d739b43 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:02.121009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 569/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 14:00:01 2022] GET /identity/v3/projects/c376bb60db2f483183ad4efd1d975ebc => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:02.126815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:02.176877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:02.221973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8484-ff52-4ede-80d2-c4d41aa3ac62 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:02.255274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:02.255857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:02.256135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:02.256405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:02.257124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=c376bb60db2f483183ad4efd1d975ebc, user.id=8f3d5eb3cbf94b04928238eacced5929) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:02.257463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:02.258864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8e0ac-1581-4354-8965-45bec5b66379 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:02.264361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 592/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:00:02 2022] GET /identity/v3/role_assignments?user.id=8f3d5eb3cbf94b04928238eacced5929&scope.project.id=c376bb60db2f483183ad4efd1d975ebc&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:04.405646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82211c5-c9db-41aa-aa1e-f5a2984e843f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:04.406199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82211c5-c9db-41aa-aa1e-f5a2984e843f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:04.406199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82211c5-c9db-41aa-aa1e-f5a2984e843f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:04.407508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 570/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:04.413213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:04.413613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:04.413792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:04.432024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:04.433192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:04.496471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 593/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:04.762000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82211c5-c9db-41aa-aa1e-f5a2984e843f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:04.822307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:04.860378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82211c5-c9db-41aa-aa1e-f5a2984e843f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:04.893703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:04.894293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:04.894574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:04.894848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:04.958484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:04.959925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:05.016331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:05.054064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 571/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:00:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:00:05.059869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:05.103921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:05.159609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf492a9-d631-4ae0-b5b3-be800396fc8b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:05.192932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:05.193582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:05.193867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:05.194143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:05.200543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:05.202019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-f8855f7f-54a3-48fb-bd77-da61ee957cd5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:00:05.213082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:00:05.214256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:00:05.215115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 594/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 14:00:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:00:05.220178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:05.315092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba90c-fd42-4183-99ce-336baa29fd52 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:05.347264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:05.347849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:05.348129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:05.348400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:05.349029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:05.349357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:05.350705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60320e-7bed-4855-a1f3-dd9bbcc9680e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:05.357540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 572/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 14:00:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:07.480942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428183-9998-487e-81f0-39fb3da21cb0 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:07.481534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428183-9998-487e-81f0-39fb3da21cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:07.481534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428183-9998-487e-81f0-39fb3da21cb0 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:07.482861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 595/1167] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:07.488205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76c2e-ad34-4355-bc82-d6d23aafe147 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:07.488605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76c2e-ad34-4355-bc82-d6d23aafe147 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:07.488759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d76c2e-ad34-4355-bc82-d6d23aafe147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:07.506776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-30d76c2e-ad34-4355-bc82-d6d23aafe147 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:07.507957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-30d76c2e-ad34-4355-bc82-d6d23aafe147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:07.527688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:07.572850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 573/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:07.845061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428183-9998-487e-81f0-39fb3da21cb0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:07.943330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428183-9998-487e-81f0-39fb3da21cb0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:07.949971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:07.976052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:07.976652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:07.976936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:07.977213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:07.977947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:07.979304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be040d4d-ad89-4fd6-b197-ae7099acaa81 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:07.994726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 596/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Oct 5 14:00:07 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:00:10.119760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc5b5-e93f-4069-a590-7399e107aa1a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:10.120267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc5b5-e93f-4069-a590-7399e107aa1a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:10.120267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fc5b5-e93f-4069-a590-7399e107aa1a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:10.121630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 574/1170] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:10.126700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:10.127574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:10.127773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:10.145802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:10.146960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:10.211592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 597/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:10.473932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc5b5-e93f-4069-a590-7399e107aa1a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:10.571696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fc5b5-e93f-4069-a590-7399e107aa1a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:10.606346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:10.606957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:10.607237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:10.607512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] PATH_INFO: `/v3/domains/d212052773de40ea801919d89e64a046` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:10.617731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] RBAC: Authorizing `identity:get_domain(domain_id=d212052773de40ea801919d89e64a046)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:10.619162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7aa66-287b-4e35-b420-15e6fb2c026f None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:10.620710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 575/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 5 14:00:10 2022] GET /identity/v3/domains/d212052773de40ea801919d89e64a046 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:10.626461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:10.713949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:10.720321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5cacf-d8b2-4790-a947-36824c901310 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:10.753394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:10.753996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:10.754274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:10.754545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:10.755179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:10.756603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d25cd-b379-4d7b-814b-3a28efc2185f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:10.782513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 598/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 14:00:10 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:00:12.938236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e908a-d85e-4e07-b6a1-7e68f6052867 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:12.938780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e908a-d85e-4e07-b6a1-7e68f6052867 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:12.938780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e908a-d85e-4e07-b6a1-7e68f6052867 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:12.940149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 576/1174] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:12.945467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:12.945894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:12.946001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:12.964511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:12.965709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:13.034547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 599/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:13.306329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e908a-d85e-4e07-b6a1-7e68f6052867 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:13.325110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:13.406030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e908a-d85e-4e07-b6a1-7e68f6052867 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:13.438765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:13.439968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:13.440249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:13.440525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] PATH_INFO: `/v3/domains/d212052773de40ea801919d89e64a046` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:13.441659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] RBAC: Authorizing `identity:get_domain(domain_id=d212052773de40ea801919d89e64a046)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:13.443080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18556-48e7-491a-9b41-b1f3ade4953e None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:13.444631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 577/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 5 14:00:13 2022] GET /identity/v3/domains/d212052773de40ea801919d89e64a046 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:13.450289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:13.527038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:13.548537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec31be-ad81-4ae7-a3c7-c89e9fe4d5e0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:13.582231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:13.582779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:13.583062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:13.583337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:13.583991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:13.585447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848f06a-cac4-40a7-a2a9-abb57d2e1a0b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:13.605632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 600/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 14:00:13 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:00:15.752526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b112-d9ba-4ab2-8cad-bc7619a56f73 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:15.753078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b112-d9ba-4ab2-8cad-bc7619a56f73 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:15.753078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b112-d9ba-4ab2-8cad-bc7619a56f73 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:15.754419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 578/1178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:15.759670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:15.760104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:15.760212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:15.777943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:15.779114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:15.843381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 601/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:16.112079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b112-d9ba-4ab2-8cad-bc7619a56f73 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:16.194952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:16.212235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b112-d9ba-4ab2-8cad-bc7619a56f73 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:16.244970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:16.245597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:16.245874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:16.246141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:16.256316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:00:16.260986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:00:16.262125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:00:16.262999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 579/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:00:16.268119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:16.326884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:16.363591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ffb0-1764-4ad9-82ef-adfc558eb4df None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:16.396224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:16.396822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:16.397105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:16.397416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:16.398079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:16.398386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:16.399745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:16.407415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 602/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:16.413208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:16.511483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfd4a-33e1-41f5-b3d0-fdb10f2fa528 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:16.543908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:16.544508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:16.544789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:16.545062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] PATH_INFO: `/v3/users/c187522168de4359aa7c98d5784b567a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:16.558116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c187522168de4359aa7c98d5784b567a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:16.559528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:16.561071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 580/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 14:00:16 2022] GET /identity/v3/users/c187522168de4359aa7c98d5784b567a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:16.566813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:16.665788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524618b-27c5-4ff2-9dae-f08d407533c7 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:16.689976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:16.698609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:16.699210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:16.699493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:16.699771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:16.763842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:16.765337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:16.860435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 603/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:00:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:00:16.867261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:16.870199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:16.962872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff72d-2ef9-48f0-b24b-015c077ee4c8 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:16.995311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:16.995917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:16.996193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:16.996462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] PATH_INFO: `/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:16.997573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] RBAC: Authorizing `identity:get_project(project_id=1f0003145e544dc4bc9b0c7a9dddcde0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:16.998982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3bfa0-dd26-4c2c-b2a7-011ca5f56ecb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:17.000564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 581/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 14:00:16 2022] GET /identity/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:17.006723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:17.032656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:17.102882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c7d3-f9f9-44f2-adc2-b64b7f8aae6e None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:17.135348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:17.135941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:17.136228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:17.136504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:17.137248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=1f0003145e544dc4bc9b0c7a9dddcde0, user.id=c187522168de4359aa7c98d5784b567a) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:17.137559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:17.138980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8f90-35d1-4855-889e-a5e071ce5ba7 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:17.144678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 604/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:00:17 2022] GET /identity/v3/role_assignments?user.id=c187522168de4359aa7c98d5784b567a&scope.project.id=1f0003145e544dc4bc9b0c7a9dddcde0&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:19.250686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a747a-e465-4d5c-ae2c-642851f67266 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:19.251198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a747a-e465-4d5c-ae2c-642851f67266 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:19.251311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a747a-e465-4d5c-ae2c-642851f67266 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:19.253161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 582/1186] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:19.258256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:19.258637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:19.258808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:19.276400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:19.277617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:19.341173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 605/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:19.610333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a747a-e465-4d5c-ae2c-642851f67266 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:19.679162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:19.709156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a747a-e465-4d5c-ae2c-642851f67266 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:19.742457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:19.743059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:19.743339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:19.743612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:19.753625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:00:19.758305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:00:19.759372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:00:19.760573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 583/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:00:19.765402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:19.786766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:19.861612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb9fc1-a62c-462e-802e-a40b6b002a2e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:19.894050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:19.894648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:19.894928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:19.895202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:19.895860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:19.896163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:19.897548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:19.905297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 606/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:19.911638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:20.005566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a7b1-5ad0-49cd-a639-05d9e8f120ea None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:20.032386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:20.038667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:20.039264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:20.039541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:20.039812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] PATH_INFO: `/v3/users/c187522168de4359aa7c98d5784b567a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:20.040883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] RBAC: Authorizing `identity:get_user(user_id=c187522168de4359aa7c98d5784b567a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:20.042332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:20.043863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 584/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 14:00:19 2022] GET /identity/v3/users/c187522168de4359aa7c98d5784b567a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:20.049625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:20.127722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:20.145615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1293ba-5466-433f-aa7c-b4ffb940faf4 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:20.177620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:20.178241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:20.178524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:20.178801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] PATH_INFO: `/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:20.179907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0003145e544dc4bc9b0c7a9dddcde0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:20.181378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c01dd-2fbd-4869-975a-24b044ebd668 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:20.182982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 607/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 14:00:20 2022] GET /identity/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:20.188853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:20.284929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffeef-1cd9-43d4-8e86-d93c466a5b1c None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:20.317632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:20.318298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:20.318609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:20.318854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] PATH_INFO: `/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0/users/c187522168de4359aa7c98d5784b567a/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:20.320724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0003145e544dc4bc9b0c7a9dddcde0, user_id=c187522168de4359aa7c98d5784b567a, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:20.322173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5c6cf-1c23-44e4-bf43-bd90b65b0619 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:20.334098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 585/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 14:00:20 2022] PUT /identity/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0/users/c187522168de4359aa7c98d5784b567a/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:00:22.433867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7dc3-8d58-4567-8d4e-4eb986b23fe4 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:22.434397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7dc3-8d58-4567-8d4e-4eb986b23fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:22.434397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7dc3-8d58-4567-8d4e-4eb986b23fe4 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:22.435738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 608/1193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:00:22.441001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:22.441452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:22.441597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:22.459772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:00:22.460948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:00:22.511505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:22.525736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 586/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:00:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:00:22.792487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7dc3-8d58-4567-8d4e-4eb986b23fe4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:22.890015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7dc3-8d58-4567-8d4e-4eb986b23fe4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:22.922538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:22.923671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:22.923965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:22.924239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:22.933990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:00:22.938696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:00:22.940132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:00:22.940982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 609/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:00:22.946291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:23.039577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973bfcf-5247-4597-a891-c759d11db216 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:23.071970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:23.072555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:23.072839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:23.073114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:23.073804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:23.074108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:23.075457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:23.083079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 587/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:00:23.088830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:23.101941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:23.186976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdc480-091d-414c-88d5-404177ff4af0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:23.218826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:23.219433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:23.219709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:23.219979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] PATH_INFO: `/v3/users/c187522168de4359aa7c98d5784b567a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:23.221706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] RBAC: Authorizing `identity:get_user(user_id=c187522168de4359aa7c98d5784b567a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:23.223157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:23.224697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 610/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 14:00:23 2022] GET /identity/v3/users/c187522168de4359aa7c98d5784b567a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:00:23.230288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:23.277576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:23.325828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b377997-0b33-4424-b2a7-301361a456ce None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:23.357180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:23.357791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:23.358064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:23.358334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:23.421420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:23.422844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:23.468082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:23.516667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 588/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:00:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:00:23.523276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:23.597882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:23.618564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a92b-fc80-409e-946f-f17b9704fc9f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:23.651104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:23.651726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:23.652006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:23.652278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] PATH_INFO: `/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:23.653395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0003145e544dc4bc9b0c7a9dddcde0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:23.654823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dc3f8-f7ff-4dce-9421-f33c47f52e57 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:23.656417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 611/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 14:00:23 2022] GET /identity/v3/projects/1f0003145e544dc4bc9b0c7a9dddcde0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:23.662384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:00:23.757248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85aa0c-57b9-479d-b67a-f87392ef77d6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:00:23.790388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:00:23.790975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:00:23.791251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:00:23.791523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:00:23.792228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=1f0003145e544dc4bc9b0c7a9dddcde0, user.id=c187522168de4359aa7c98d5784b567a) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:00:23.792529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:00:23.793955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1e5a4-a82a-4ba0-a0b6-e555814b50f6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:00:23.799948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 589/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:00:23 2022] GET /identity/v3/role_assignments?user.id=c187522168de4359aa7c98d5784b567a&scope.project.id=1f0003145e544dc4bc9b0c7a9dddcde0&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:00:33.647116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=27 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:00:33.796891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:19.329526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddca3-9ac4-43e6-84b7-edc0a3fb9aec None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:19.330288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddca3-9ac4-43e6-84b7-edc0a3fb9aec None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:19.330288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddca3-9ac4-43e6-84b7-edc0a3fb9aec None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:19.332570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 612/1201] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:19.337693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:19.338186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:19.338275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:19.360873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:19.362200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:19.441354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 590/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:19.753106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddca3-9ac4-43e6-84b7-edc0a3fb9aec None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:19.879652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddca3-9ac4-43e6-84b7-edc0a3fb9aec None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:19.932741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:19.933568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:19.933978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:19.934258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:19.951196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:19.952692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:19.971029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:19.973544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:19.974734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:19.974734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:19.974734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:19.974734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 613/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:19.980333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:20.105123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426d9a6-8064-46d7-98c7-5887e94a181d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:20.138780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:20.145727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:20.146478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:20.146862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:20.147238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:20.147990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:20.148394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:20.150415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35c3d-829f-479c-9a0c-fd70c9bc8fda None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:20.170585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 591/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:20.176977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:20.243466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:20.308927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee977d-5401-4542-9364-69258e57a6cf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:20.355032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:20.355733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:20.355932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:20.356212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:20.356867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:20.358468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5004279-3da6-4832-a69b-f3e3ab85f193 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:20.385166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 614/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 14:01:20 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:01:22.761868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d400b-0e73-4ebc-a550-825624221871 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:22.762446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d400b-0e73-4ebc-a550-825624221871 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:22.762550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d400b-0e73-4ebc-a550-825624221871 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:22.764424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 592/1206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:22.770076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:22.770546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:22.770634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:22.790194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:22.791615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:22.874494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 615/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:23.166358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d400b-0e73-4ebc-a550-825624221871 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:23.290174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d400b-0e73-4ebc-a550-825624221871 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:23.333526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:23.334628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:23.335180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:23.335609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:23.356348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:23.362699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:23.364898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:23.366096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 593/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 14:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:23.370814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:23.417027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:23.492651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8fdb2-4ca4-4466-ae5c-f6ed8eee3415 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:23.535752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:23.536411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:23.536721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:23.537073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:23.537751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:23.538631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:23.539604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:23.550001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 616/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 14:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:23.556263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:23.621175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:23.678967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b64360-2474-4668-a9fa-9447cfc7ed65 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:23.718944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:23.721130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:23.721130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:23.721130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:23.731638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:23.733274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:23.749546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:23.750627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:23.751635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:23.751635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:23.751635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:23.751635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 594/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:23.756772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:23.887007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:23.891564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd2d8-2d84-4465-a653-e1784089bf67 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:23.930716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:23.931305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:23.931588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:23.931863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:23.932512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:23.932817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:23.934290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:23.951217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 617/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:23.952517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:24.062434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259311a-3b42-4341-ae0d-1634288371ef None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:24.064501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:24.098183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:24.098810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:24.099085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:24.099352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:24.108463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:24.110144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:24.123225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:24.124505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:24.126303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:24.128410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 595/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:24.134331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:24.253402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1d38-9451-495b-b33b-dc98faab317d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:24.289740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:24.290350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:24.290614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:24.290891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:24.291612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:24.291920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:24.293456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:24.311205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 618/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:01:24.317306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:24.431202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba121f0-1220-46f8-97f5-dd630eb370c6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:24.473731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:24.474606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:24.474905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:24.475565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:24.518988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:24.566479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:24.568311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:24.687144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 596/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:01:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:01:24.693179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:24.718895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:24.813211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624bea-1b9c-4bf7-832a-a08587baef19 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:24.854556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:24.855518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:24.855965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:24.856404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:24.870182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:24.871921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:24.891399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:24.893190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:24.894153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:24.894153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:24.894153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:24.894153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 619/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:24.899504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:24.977721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:25.023570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6936a-8f8c-47c5-85b4-cec46de89868 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:25.064612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:25.065127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:25.065443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:25.065714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:25.066360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:25.066668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:25.068016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:25.079489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 597/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:25.085685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:25.168594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:25.205011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97cc8-e32e-4014-9a35-0863f8ddbdd6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:25.244643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:25.245342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:25.245726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:25.245986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:25.254849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:25.256606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:25.270341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:25.271446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:25.272374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 620/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:25.278073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:25.392882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebc362-6de1-4e93-a0cb-54cf6cef9ddf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:25.418572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:25.431337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:25.431950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:25.432273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:25.433949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:25.433949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:25.433949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:25.435115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211ff91-065c-4989-a100-dea6b5529b1a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:25.449074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 598/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:25.455968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:25.569985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d366f03-ebc5-44bf-8a1f-44e2bff38020 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:25.601694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:25.608651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:25.609519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:25.609808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:25.610082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:25.610811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=b1370e4280744ad6b76881a9e0fafbaa) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:25.611127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:25.613626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5644f4-a092-43a6-9362-7d445dbdeff2 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:25.620612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 621/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:01:25 2022] GET /identity/v3/role_assignments?user.id=b1370e4280744ad6b76881a9e0fafbaa&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:27.837755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da8521-d7f4-4e8b-b0d1-c4244200c799 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:27.838302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da8521-d7f4-4e8b-b0d1-c4244200c799 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:27.838302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da8521-d7f4-4e8b-b0d1-c4244200c799 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:27.839909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 599/1220] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:27.845670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:27.846135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:27.846239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:27.865267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:27.866460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:27.943578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 622/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 14:01:28.287519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da8521-d7f4-4e8b-b0d1-c4244200c799 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:28.411421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da8521-d7f4-4e8b-b0d1-c4244200c799 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:28.447014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:28.447705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:28.448052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:28.448399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:28.460656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:28.466056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:28.468077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:28.470615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 600/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 14:01:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:28.481250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:28.584544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3c0e1-6600-49ba-88b0-911398421afb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:28.608588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:28.620792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:28.621433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:28.621722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:28.622018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:28.622658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:28.622967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:28.624340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:28.634425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 623/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 14:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:28.640758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:28.694317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:28.752921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7422d-2bd8-4a70-828c-7618e96e73b2 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:28.792166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:28.792811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:28.793109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:28.793415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:28.804965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:28.806551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:28.825810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:28.832944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:28.834106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:28.834106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:28.834106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:28.834106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 601/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:28.834378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:28.942682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18b150-6c43-480a-800a-90d82bf0e1ac None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:28.979674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:28.980322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:28.980605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:28.980888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:28.981615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:28.981963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:28.983463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:28.996487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 624/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:29.004283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:29.107708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:29.115496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c33a-8b48-4a65-a858-0e40e5ad13b6 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:29.151323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:29.151924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:29.152276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:29.152595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:29.160714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:29.162177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:29.174275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:29.175419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:29.176577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 602/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:29.182454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:29.238140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:29.305067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e942-b1df-4e76-ade5-d7fd2386f3db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:29.342172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:29.342771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:29.343133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:29.343389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:29.344715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:29.344984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:29.346439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:29.365116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 625/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:29.371350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:29.490393 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161b89-1245-40ff-8d29-3abd71d05846 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:29.528121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:29.528832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:29.529109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:29.529514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:29.541458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:29.542909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:29.558154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:29.559201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:29.565677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:29.565677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:29.565677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:29.565677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 603/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:29.566114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:29.674389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6534b-3c5b-48d7-be3c-f8c381349880 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:29.677011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:29.712038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:29.712731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:29.713112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:29.713447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:29.714216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:29.714574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:29.716093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:29.729109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 626/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:29.734998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:29.744983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:29.847285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56d5d9-dd55-4a8a-b3c7-2f25e1159abe None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:29.883955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:29.884591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:29.884949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:29.885318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:29.892922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:29.895552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:29.913350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:29.914504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:29.915410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 604/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:29.922286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:30.034097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6f175-6b28-4486-bb4f-c617967d064c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:30.081562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:30.082189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:30.082473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:30.082744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:30.083573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:30.084080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:30.085892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff9214-20eb-4680-82b5-5e120d43740a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:30.100763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 627/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:30.106772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:30.174556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:30.214712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4be9a-e91f-4763-a097-dfa18e373983 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:30.254139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:30.254937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:30.255380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:30.255691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/b1370e4280744ad6b76881a9e0fafbaa/roles/d245f9f0c9364bc28b8f5ac6a1a305ef` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:30.272189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=b1370e4280744ad6b76881a9e0fafbaa, role_id=d245f9f0c9364bc28b8f5ac6a1a305ef)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:30.273668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3ba7-70d9-4320-a899-a698129aee52 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:30.286185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 605/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 14:01:30 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/b1370e4280744ad6b76881a9e0fafbaa/roles/d245f9f0c9364bc28b8f5ac6a1a305ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:01:32.584204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582b0c-5a8f-4f2f-b1c8-743b78e677d9 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:32.584747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582b0c-5a8f-4f2f-b1c8-743b78e677d9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:32.584747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed582b0c-5a8f-4f2f-b1c8-743b78e677d9 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:32.586130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 628/1233] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:32.591304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:32.591716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:32.591852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:32.612571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:32.614104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:32.685935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 606/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:32.960956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed582b0c-5a8f-4f2f-b1c8-743b78e677d9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:32.988757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:33.076152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed582b0c-5a8f-4f2f-b1c8-743b78e677d9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:33.114140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:33.114832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:33.115184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:33.115544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:33.127540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:33.132571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:33.133773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:33.134668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 629/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 14:01:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:33.139737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:33.189934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:33.253340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa5635-b151-41ac-b268-f127edd1d129 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:33.288441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:33.289045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:33.289366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:33.289655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:33.290307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:33.290635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:33.291981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:33.300592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 607/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 14:01:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:33.306679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:33.398833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:33.417048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ad53-b4e4-4cec-a7df-c3ed04a99585 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:33.459386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:33.460046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:33.460508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:33.460786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:33.474802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:33.476787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:33.496983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:33.498313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:33.499349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:33.499349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:33.499349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:33.499349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 630/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:33.506225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:33.618927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17878f-3cf8-42da-983f-637a2ae051f1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:33.628771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:33.654953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:33.655678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:33.655948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:33.656250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:33.657045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:33.657384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:33.658816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:33.672932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 608/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:33.678920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:33.786178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df601f-4f38-4449-bcec-faa58a9c014d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:33.823950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:33.824722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:33.825073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:33.825417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:33.828444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:33.835000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:33.836662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:33.849135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:33.850414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:33.851611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 631/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:33.856782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:33.966569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e6a6-c293-46f5-80cf-8ddafc5c9d50 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:34.005785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:34.006501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:34.006783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:34.007058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:34.007794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:34.008109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:34.009809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:34.030107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 609/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:34.037187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:34.146855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c800b9b-86f3-42db-8244-1c0b19e6a0bf None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:34.180765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:34.181388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:34.181670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:34.181944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:34.253847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:34.263291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:34.266055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:34.379684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 632/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:01:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:01:34.385920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:34.415069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:34.500948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e04f83-64c2-47d3-a11b-6a8926d0a1c7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:34.541062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:34.541731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:34.542017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:34.542364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:34.553593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:34.555058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:34.571451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:34.572544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:34.573492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:34.573492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:34.573492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:34.573492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 610/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:34.578977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:34.680068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:34.686471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d975-0051-4281-b235-c9db7edb9338 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:34.724228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:34.725201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:34.725201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:34.725574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:34.726299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:34.726696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:34.728343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:34.741518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 633/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:01:34.747184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:34.832492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:34.856737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbddd04-7243-4fa4-aa13-602e0de0da56 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:34.894391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:34.895017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:34.895294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:34.895564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:34.903203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:34.904763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:34.916789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:34.917884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:34.918944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 611/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:34.924096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:35.034789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655832-27c9-4196-90d8-a3e5457d3ac9 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:35.072969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:35.073598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:35.073877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:35.074158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:35.074924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:35.075295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:35.076915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ddf7c-ff0f-466b-a984-d9978ab93d3a None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:35.090245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 634/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:01:35.097017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:35.205124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549ac70-8812-4dca-b8b1-b6ec5f925358 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:35.241244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:35.241862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:35.242141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:35.242414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:35.243129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] RBAC: Adding query filter params (role.id=d245f9f0c9364bc28b8f5ac6a1a305ef, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=b1370e4280744ad6b76881a9e0fafbaa) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:35.243436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:35.244850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cc7bf-b954-4eeb-a154-42cb49b37a60 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:35.251770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 612/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:01:35 2022] GET /identity/v3/role_assignments?user.id=b1370e4280744ad6b76881a9e0fafbaa&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=d245f9f0c9364bc28b8f5ac6a1a305ef => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:37.579151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ba9a-ce4e-486a-b0e7-2baf5c254845 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:37.579706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ba9a-ce4e-486a-b0e7-2baf5c254845 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:37.579706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ba9a-ce4e-486a-b0e7-2baf5c254845 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:37.581252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 635/1247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 14:01:37.586318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:37.586807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:37.586933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:37.593163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:37.606627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:37.607824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:37.679992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 613/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:37.961610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ba9a-ce4e-486a-b0e7-2baf5c254845 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:37.981129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:38.070111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ba9a-ce4e-486a-b0e7-2baf5c254845 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.105409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.106038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.106320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.106595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.116938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:38.122168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:38.123302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:38.124467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 636/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:38.129315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:38.234272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5901d-41f5-43dc-aad1-5001f3ee2e84 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.266542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:38.272664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.273324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.273628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.273959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.274695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:38.275059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:38.276525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:38.290620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 614/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:38.291881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:38.380725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:38.405776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274002-7ce9-4de7-9963-a8d11caaf131 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.455332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.455996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.456275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.456545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.468682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:38.470428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:38.490427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:38.491595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:38.492538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:38.492538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:38.492538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:38.492538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 637/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:38.498020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:38.607531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1bf61-58fc-40c6-8ba0-557ebff113eb None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.643062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.643671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.643979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.644249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.644895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:38.645195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:38.646589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:38.660088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 615/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:38.665908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:38.768387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e059-61cd-4366-9bbf-1e4a5c40080d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.799002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:38.807940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.808590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.808872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.809144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.818105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:38.819596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:38.831745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:38.832941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:38.833996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 638/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:38.838921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:38.895743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:38.940707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2abfa-ed8a-4903-9174-0130678d6d32 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:38.974654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:38.975261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:38.975540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:38.975808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:38.976534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:38.976836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:38.978287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:38.996021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 616/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:39.002509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.104253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d99a6-ed95-4841-91e4-4daf1f9e5770 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:39.137516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:39.138117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:39.138396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:39.138669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:39.191514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:39.203339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:39.204784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:39.298627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 639/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 05 14:01:39.304435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.399432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d040623-c5f6-4bae-a7cb-3e3c049ea727 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:39.412365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:39.432496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:39.433106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:39.433419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:39.433693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:39.443235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:39.444649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:39.459022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:39.460113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:39.461284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:39.461284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:39.461284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:39.461284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 617/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:39.465810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.558202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:39.569854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e231d-6c22-47b9-802a-bd6c17c5871f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:39.602602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:39.603197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:39.603477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:39.603751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:39.604379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:39.604679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:39.606062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:39.616815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 640/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:39.622488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.717031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c408-6e12-4d35-84fb-727105841b6b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:39.748697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:39.749318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:39.750097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:39.750364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:39.756719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:39.758156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:39.769598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:39.770648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:39.771723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 618/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:39.776345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.871958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616094-0588-4658-ac9b-e8f0da28cf3c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:39.904595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:39.905193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:39.905505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:39.905806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:39.906483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:39.906787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:39.908216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10e16-9dc7-473e-8e28-f3d28209e00b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:39.919569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 641/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:39.925746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:39.950889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:40.022417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344c35-12e5-46d8-aef7-c62a74ef17c7 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:40.053734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:40.054322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:40.054605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:40.054882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:40.055590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=b1370e4280744ad6b76881a9e0fafbaa) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:40.055897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:40.057337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4290-9780-4dd7-8a93-61d28eb3bdfa None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:40.063053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 619/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:01:39 2022] GET /identity/v3/role_assignments?user.id=b1370e4280744ad6b76881a9e0fafbaa&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:42.152552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6c74-373e-4915-aebb-6c4b8f1149f7 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:42.153062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6c74-373e-4915-aebb-6c4b8f1149f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:42.153062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e6c74-373e-4915-aebb-6c4b8f1149f7 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:42.154372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 642/1261] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:42.159596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:42.159972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:42.160183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:42.178627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:42.179800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:42.243325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 620/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:42.515316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e6c74-373e-4915-aebb-6c4b8f1149f7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:42.527780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:42.617745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e6c74-373e-4915-aebb-6c4b8f1149f7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:42.650152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:42.650772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:42.651050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:42.651321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:42.661034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:42.665750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:42.666840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:42.668004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 643/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:42.673404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:42.691335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:42.766937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922c27e-5f94-42f8-8e14-0fdc9a83ebbb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:42.799719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:42.800311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:42.800586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:42.800853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:42.801545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:42.801845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:42.803192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:42.810798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 621/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:42.816463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:42.881372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:42.913368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfe5a6-f38d-4cff-bae3-190b6cda0241 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:42.945653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:42.946262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:42.946549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:42.946819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:42.956322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:42.957796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:42.972185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:42.973299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:42.974207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:42.974207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:42.974207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:42.974207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 644/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:42.979087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.056274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:43.074296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384642b-c697-41bf-a64d-be40af0e71bf None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.106140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.106728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.107006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.107275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.107898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:43.108196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.110099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.121408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 622/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:43.127138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.223587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3bf0-6a02-4cfa-a72e-7417316cc27d None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.242628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:43.256898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.257549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.257829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.258100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.265112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.266574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:43.277173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:43.283049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:43.284267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 645/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:43.284991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.379102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea3c69-60f6-415e-826a-0a2d60610d82 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.410348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.410929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.411205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.411475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.412180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:43.412479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.413923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.422652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:43.431101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 623/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:43.437486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.540177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84629960-61c9-464a-a07e-c7e566e95523 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.571868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.572483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.572762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.573032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.583033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.584464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:43.598209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:43.599291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:43.600606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:43.600606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:43.600606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:43.600606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 646/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:43.605028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.702560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620758-c0b3-4e9f-a968-c98a85dd5547 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.736940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.737554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.737830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.738097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.738977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:43.739272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.740615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.751303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 624/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:43.756968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.787541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:43.853790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf887c-8e18-4085-b004-ba2d5f65f5c0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:43.886105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:43.886723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:43.887003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:43.887276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:43.894091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:43.895541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:43.907430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:43.908473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:43.909619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 647/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:43.914339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:43.971031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:44.011550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482493cb-b418-45e7-8c32-87ca79dd7eb1 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:44.045986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:44.046617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:44.046895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:44.047166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:44.047842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:44.048145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:44.049591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64aa1-04ee-432d-83d1-65f3ad979141 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:44.060990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 625/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:44.066994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:44.154452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:44.163852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9eabd-72fa-4ae9-8ad9-c49ebc33c26b None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:44.195483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:44.196126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:44.196408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:44.196682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] PATH_INFO: `/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/b1370e4280744ad6b76881a9e0fafbaa/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:44.198564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] RBAC: Authorizing `identity:create_grant(project_id=48a0eb4677d64941af58cc1ebf006dda, user_id=b1370e4280744ad6b76881a9e0fafbaa, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:44.199986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7280b77-8eef-4b65-85b9-d0d23b26a102 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:44.212331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 648/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 14:01:44 2022] PUT /identity/v3/projects/48a0eb4677d64941af58cc1ebf006dda/users/b1370e4280744ad6b76881a9e0fafbaa/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:01:46.331651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b34b-09d2-439a-b7ed-b89a1ccd9088 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:46.332181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b34b-09d2-439a-b7ed-b89a1ccd9088 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:46.332181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1b34b-09d2-439a-b7ed-b89a1ccd9088 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:46.333551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 626/1274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:46.338610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:46.339027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:46.339167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:46.356850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:46.358070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:46.422448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 649/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:46.707710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1b34b-09d2-439a-b7ed-b89a1ccd9088 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:46.806561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1b34b-09d2-439a-b7ed-b89a1ccd9088 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:46.822668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:46.838813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:46.839422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:46.839696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:46.839964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:46.850000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 14:01:46.854634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:46.855723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:46.857026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 627/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 14:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:46.862252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:46.938513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:46.957193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199b9f-1cb9-49d5-b3a0-d1c2da987658 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:46.989519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:46.990111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:46.990387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:46.990654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:46.991303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:46.991598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:46.992939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.000524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 650/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 14:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:47.006152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.101698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9060e-167d-4226-9433-d82424a15557 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:47.133306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:47.133904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:47.134179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:47.134447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:47.144395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:47.145853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:47.160203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:47.161412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:47.162338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:47.162338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:47.162338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:47.162338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 628/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:47.167024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.262332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201728-c1ae-4516-9b03-107c11f8137f None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:47.293690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:47.294278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:47.294554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:47.294823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:47.295447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:47.295745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:47.297129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.308064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 651/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:01:47.314280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.344399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:47.412264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40739d38-9805-42fb-8d5a-a2e53b631555 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:47.443822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:47.444419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:47.444694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:47.444961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:47.451943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:47.453993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 14:01:47.464574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:47.465667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:47.466648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 629/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 14:01:47.472306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.476020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:47.568876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce505e6-d716-48e0-8248-a3abe84d287c None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:47.601645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:47.602240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:47.602523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:47.602798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:47.603510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:47.603821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:47.605305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.623054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 652/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:01:47.629304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.716400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:47.726040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bd080-7e55-4ff1-962c-4487b160a9f3 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:47.759122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:47.759707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:47.759991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:47.760264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:47.825821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:47.827219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:47.909985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:47.920296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 630/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 14:01:47.926720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:47.984663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:48.021938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287be9-4087-4d27-9020-5acd23b796db None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:48.054579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:48.055190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:48.055466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:48.055735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:48.065171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:48.066627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 14:01:48.080444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:48.081595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 14:01:48.082513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 14:01:48.082513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 14:01:48.082513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:48.082513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 653/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:48.087328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:48.182080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431251d6-943f-4f95-bc0b-298455827113 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:48.213589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:48.214174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:48.214456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:48.214729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:48.215359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:48.215660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:48.217002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:48.229039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 631/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 14:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:48.235231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:48.331445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911d6a-6868-4ee7-b226-cbd9091944d0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:48.344589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:48.364722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:48.365369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:48.365649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:48.365919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:48.372188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:48.373656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 14:01:48.384347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:48.385470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: ERROR keystone.server.flask.application Oct 05 14:01:48.386400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 654/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 14:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:48.391896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:48.439848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:48.490127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5f25-9bab-48e8-9c01-ae04554fc0de None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:48.522530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:48.523119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:48.523398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:48.523671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:48.524348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:48.524652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:48.526097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e777c4-37bc-4ad1-9de4-a582c8af2347 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:48.538166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 632/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 14:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:48.544193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:48.641083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717c99d-4d51-4eb7-8a0e-272a4964a9c0 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:48.673080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:48.673708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:48.673989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:48.674263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:48.674990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] RBAC: Adding query filter params (role.id=7cd2a85ba9004397b74226de1219a45f, scope.project.id=48a0eb4677d64941af58cc1ebf006dda, user.id=b1370e4280744ad6b76881a9e0fafbaa) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:48.675299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:48.676735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2aaaa-28d4-4205-a710-63c82286e54b None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:48.682419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 655/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 14:01:48 2022] GET /identity/v3/role_assignments?user.id=b1370e4280744ad6b76881a9e0fafbaa&scope.project.id=48a0eb4677d64941af58cc1ebf006dda&role.id=7cd2a85ba9004397b74226de1219a45f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:50.831475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76538-5fec-41b6-9762-ffb9ec211eeb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:50.831930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76538-5fec-41b6-9762-ffb9ec211eeb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:50.832016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76538-5fec-41b6-9762-ffb9ec211eeb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:50.833397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 633/1288] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:50.838501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:50.838872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:50.839064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:50.857366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:50.859069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:50.887933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:50.924274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 656/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:51.196374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76538-5fec-41b6-9762-ffb9ec211eeb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:51.304844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76538-5fec-41b6-9762-ffb9ec211eeb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:51.315723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:51.338785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:51.339401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:51.339678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:51.339951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:51.340525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:51.341924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:51.350362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:51.351614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:51.352764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 634/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 14:01:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:51.357504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:51.453784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0668f-bc5e-4293-b4c8-4a2580a98436 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:51.492241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:51.493141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:51.493647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:51.493955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:51.494955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:51.495446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:51.497468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fd9a3-91ec-4f6d-b53a-883f4019e0d0 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:51.504616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 657/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 14:01:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:51.510946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:51.615722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c94e-574c-4c9f-8308-cd403a1b6453 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:51.648113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:51.648712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:51.648996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:51.649296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] PATH_INFO: `/v3/services` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:51.649923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:51.650230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:51.651601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1256-7afd-4eba-934c-548dcdd15167 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:51.655892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 635/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 14:01:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:53.756626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1f78-008b-4f42-b962-2cc41d41ba3c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:53.757156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1f78-008b-4f42-b962-2cc41d41ba3c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:53.757156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1f78-008b-4f42-b962-2cc41d41ba3c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:53.758570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 658/1293] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:53.763710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85cb6-d4d4-4155-b628-4ae13a85eb8d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:53.764100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85cb6-d4d4-4155-b628-4ae13a85eb8d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:53.764258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85cb6-d4d4-4155-b628-4ae13a85eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:53.783013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-51f85cb6-d4d4-4155-b628-4ae13a85eb8d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:53.784199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51f85cb6-d4d4-4155-b628-4ae13a85eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:53.812469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:53.848906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 636/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:54.115342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc1f78-008b-4f42-b962-2cc41d41ba3c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:54.145548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:54.213348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc1f78-008b-4f42-b962-2cc41d41ba3c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:54.246356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:54.246949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:54.247231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:54.247507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:54.248153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:54.249535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19786b-af1b-4847-9345-3dbbf706d567 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:54.263240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 659/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 14:01:54 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:01:56.360501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b946b-01f1-4f9c-9134-df4fb4f865bd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:56.361080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b946b-01f1-4f9c-9134-df4fb4f865bd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:56.361080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b946b-01f1-4f9c-9134-df4fb4f865bd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:56.362416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 637/1296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:56.367900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:56.368318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:56.368451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:56.386252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:56.387427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:56.456444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 660/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:56.738630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b946b-01f1-4f9c-9134-df4fb4f865bd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:56.835439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b946b-01f1-4f9c-9134-df4fb4f865bd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:56.867454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:56.868060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:56.868336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:56.868611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:56.869184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:56.870559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:56.879439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:56.880695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:56.881786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 638/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 14:01:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:56.886417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:56.903851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:56.981372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55781555-f9de-4303-9534-d7717a8e9dbe None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:57.014518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:57.015050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:57.015332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:57.015609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:57.016235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:57.016539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:57.017931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:57.022842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 661/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 14:01:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:57.028625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:57.060058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:57.129369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c1a5d-5d0f-4a33-86ad-c0675d825a8b None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:57.161607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:57.162197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:57.162480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:57.162757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:57.163452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] RBAC: Adding query filter params (interface=public, service_id=12a5309f09284ca28a185f9b5c7c2f24, region_id=RegionOne) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:01:57.163762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:57.165124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6323d-6be8-45dc-a1f4-a5a39550a8fb None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:57.169982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 639/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 14:01:57 2022] GET /identity/v3/endpoints?service_id=12a5309f09284ca28a185f9b5c7c2f24&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:01:57.176252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:57.254780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:57.272421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8f75-a37f-4dda-9bb6-b431072b2de6 None admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:57.305587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:57.306191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:57.306473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:57.306750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:57.307353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:57.308720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5fba8-7874-48a9-a126-5dd610049e58 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:57.315380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 662/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 14:01:57 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:01:59.420532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd82bf-d4f3-4743-a010-15123aa656da None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:59.421095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd82bf-d4f3-4743-a010-15123aa656da None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:59.421095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd82bf-d4f3-4743-a010-15123aa656da None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:59.422472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 640/1302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:01:59.427449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:59.427867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:59.427988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:59.446306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:01:59.447493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:01:59.515476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 663/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:01:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 14:01:59.788804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd82bf-d4f3-4743-a010-15123aa656da None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:01:59.883482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:01:59.890760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd82bf-d4f3-4743-a010-15123aa656da None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:01:59.923442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:01:59.924046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:01:59.924324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:01:59.924594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:01:59.925167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:01:59.926535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 14:01:59.934942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 14:01:59.936726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application with Lock( Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self._enter() Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application return self.creator() Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application created_value = creator( Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: ERROR keystone.server.flask.application Oct 05 14:01:59.937807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 641/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 14:01:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 14:01:59.942503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:02:00.019686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:02:00.042689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adc0e0-0eb0-4358-8e44-43e8b99b8e6e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:02:00.075709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:02:00.076306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:02:00.076612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:02:00.076888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] PATH_INFO: `/v3/services` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:02:00.077545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:02:00.077847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:02:00.079272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824e459-b691-4000-9d21-48e818058cd8 None admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:02:00.084077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 664/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 14:01:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:02:00.089887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:02:00.185100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a61c6-26b7-4f17-a20a-6a7c5ab20563 None admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:02:00.216062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:02:00.216634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:02:00.216911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:02:00.217709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:02:00.218370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:02:00.219712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9893e-8de3-4226-9d04-97450ee2cf4a None admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:02:00.238803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 642/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:02:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:02:10.081266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=30 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:02:10.233762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:04.032819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe569ea-a9b1-4c43-9440-ca0aac113574 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:04.033323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe569ea-a9b1-4c43-9440-ca0aac113574 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:04.033490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe569ea-a9b1-4c43-9440-ca0aac113574 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:04.039979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c79445-4555-455c-83f6-3dddeb59980a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:04.040389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c79445-4555-455c-83f6-3dddeb59980a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:04.040565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c79445-4555-455c-83f6-3dddeb59980a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:04.045308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 665/1307] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:04.150231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-45c79445-4555-455c-83f6-3dddeb59980a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:04.151778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45c79445-4555-455c-83f6-3dddeb59980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:04.272738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 643/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:03:04.565544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:04.565831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:04.566306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:04.567665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 666/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 5 14:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:04.574041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2d74-c3f1-4fb0-9dcc-65f4ed75fc24 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:04.574419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2d74-c3f1-4fb0-9dcc-65f4ed75fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:04.574776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2d74-c3f1-4fb0-9dcc-65f4ed75fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:04.665964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-968f2d74-c3f1-4fb0-9dcc-65f4ed75fc24 None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:04.668119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-968f2d74-c3f1-4fb0-9dcc-65f4ed75fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:04.690578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:04.752822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 644/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:04.761704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:04.763511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:04.874195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f0be0-9641-49e9-8308-de951b7e4379 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:04.952997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:04.953640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:04.953926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:04.954207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:04.955810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:05.013581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:05.072942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:05.074950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23eb96-9510-4cd6-8ca6-7a71daceeeb0 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:05.095624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 667/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:07.544315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:07.544865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:07.544865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:07.546143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 645/1312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:07.551505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8b5c-8d05-42db-a4f3-d49bc7e5ae5b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:07.551952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8b5c-8d05-42db-a4f3-d49bc7e5ae5b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:07.552057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8b5c-8d05-42db-a4f3-d49bc7e5ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:07.621842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-963f8b5c-8d05-42db-a4f3-d49bc7e5ae5b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:07.623056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-963f8b5c-8d05-42db-a4f3-d49bc7e5ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:07.717831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 668/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:07.998400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:07.999977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:08.105567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709856e4-e5c9-4ae1-957d-3dc92b3694d0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:08.177951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:08.179938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:08.180534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:08.180824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:08.181301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:08.183252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:08.292124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:08.293516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78363641-e888-4f60-8620-54ba5a4ed04a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:08.311605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 646/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:10.769776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:10.770308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:10.770308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:10.771659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 669/1315] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 14:03:10.777905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c3a4-6b76-4db0-8988-47b1cadcedde None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:10.778311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c3a4-6b76-4db0-8988-47b1cadcedde None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:10.778516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c3a4-6b76-4db0-8988-47b1cadcedde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:10.842839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b038c3a4-6b76-4db0-8988-47b1cadcedde None None] MFA Rules not processed for user `a546e9619a2647578f92c00eb32a8a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:10.844025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b038c3a4-6b76-4db0-8988-47b1cadcedde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:10.894815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:10.938418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 647/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:11.217814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:11.219405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:11.229308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:11.323893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b886e6-9fc0-46d4-be0d-b7a3316c77b8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:11.394085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:11.394685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:11.394965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:11.395235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:11.396822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:11.456644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:11.503032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:11.504464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc605-0f6f-4de0-961a-e7725a1f3eea service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:11.522528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 670/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:14.151885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:14.152389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:14.152389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:14.153738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 648/1318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:14.158954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a686d3-ae77-49e3-97b6-26a16e14e8e2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:14.159380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a686d3-ae77-49e3-97b6-26a16e14e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:14.159503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a686d3-ae77-49e3-97b6-26a16e14e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:14.223028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-49a686d3-ae77-49e3-97b6-26a16e14e8e2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:14.224219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-49a686d3-ae77-49e3-97b6-26a16e14e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:14.318052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 671/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:14.601579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:14.603170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:14.705338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6dab-9e84-4dbf-abd8-9b9e721c3721 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:14.777427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:14.778032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:14.778311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:14.778585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:14.780169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:14.787168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:14.887180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:14.888557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1d718-d056-4345-86ff-ae9e2e3dde3e service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:14.906994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 649/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:17.683321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:17.683832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:17.683832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:17.685143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 672/1321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:17.690335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aba5-acab-4ea9-ab1d-d3c1dbee29c0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:17.690762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aba5-acab-4ea9-ab1d-d3c1dbee29c0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:17.690892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626aba5-acab-4ea9-ab1d-d3c1dbee29c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:17.760638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f626aba5-acab-4ea9-ab1d-d3c1dbee29c0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:17.761894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f626aba5-acab-4ea9-ab1d-d3c1dbee29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:17.826126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:17.869385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 650/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:03:18.152715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:18.154356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:18.174335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:18.256931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21579-1d29-420c-8624-2662d7b4e706 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:18.328718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:18.329364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:18.329646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:18.329918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:18.331533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:18.404115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:18.442340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:18.443786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb6565-567d-48bc-82b5-538d187de040 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:18.462107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 673/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:20.684502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:20.685031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:20.685031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:20.686430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 651/1324] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:20.691718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e377-5153-49f6-a411-53af3f818bbe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:20.692136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e377-5153-49f6-a411-53af3f818bbe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:20.692285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e377-5153-49f6-a411-53af3f818bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:20.760539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-46c1e377-5153-49f6-a411-53af3f818bbe None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:20.761784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-46c1e377-5153-49f6-a411-53af3f818bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:20.868530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 674/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:21.149923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:21.151478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:21.252823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7706-4ae2-405b-904a-20874fd2dd56 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:21.325884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:21.326490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:21.326770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:21.327042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:21.328672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:21.345320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:21.436602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:21.437965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039d61-1859-47b7-bbdf-9e3572f63970 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:21.455561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 652/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:23.662748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cfe-11ec-4192-906e-44269a6ba320 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:23.663236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cfe-11ec-4192-906e-44269a6ba320 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:23.663236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cfe-11ec-4192-906e-44269a6ba320 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:23.664577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 675/1327] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:23.670808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc6d-4c2b-4a2a-8299-6a3af2c9b779 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:23.671221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc6d-4c2b-4a2a-8299-6a3af2c9b779 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:23.671358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128bc6d-4c2b-4a2a-8299-6a3af2c9b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:23.738151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3128bc6d-4c2b-4a2a-8299-6a3af2c9b779 None None] MFA Rules not processed for user `a546e9619a2647578f92c00eb32a8a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:23.739392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3128bc6d-4c2b-4a2a-8299-6a3af2c9b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:23.805779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:23.837480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 653/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:24.138030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:24.138396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:24.138740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:24.140166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 676/1329] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 5 14:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:24.146609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012d64-6e80-435a-9752-747d16383cae None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:24.146903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012d64-6e80-435a-9752-747d16383cae None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:24.147191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012d64-6e80-435a-9752-747d16383cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:24.227248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9f012d64-6e80-435a-9752-747d16383cae None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:24.229055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f012d64-6e80-435a-9752-747d16383cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:24.307071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 654/1330] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:24.315947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:24.317637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:24.349402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:24.421843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee339b9f-1387-42f6-8596-f195027afa88 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:24.495434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:24.496047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:24.496329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:24.496604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:24.498254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:24.579683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:24.611631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:24.613085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca386d82-462e-43b7-a946-2928f9aa5878 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:24.630471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 677/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:27.389523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:27.390054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:27.390175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:27.391424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 655/1332] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 14:03:27.396542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d59e-0a80-41dc-b0c2-9ebe1aae1e6c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:27.396923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d59e-0a80-41dc-b0c2-9ebe1aae1e6c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:27.397106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d59e-0a80-41dc-b0c2-9ebe1aae1e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:27.461434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8963d59e-0a80-41dc-b0c2-9ebe1aae1e6c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:27.462666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8963d59e-0a80-41dc-b0c2-9ebe1aae1e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:27.557605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 678/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:27.840431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:27.842035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:27.910962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:27.944839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5315e4-62ad-435e-ac87-937c7dfd3a23 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:28.016755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:28.017384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:28.017669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:28.017945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:28.019568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:28.125547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:28.126913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe24dc-a449-48b1-8b5f-3398bdceb029 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:28.137170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:28.145554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 656/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:30.313777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:30.314373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:30.314373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:30.315660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 679/1335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:30.320790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561825-443d-44b5-9a7e-dbaceeae3b2e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:30.321196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561825-443d-44b5-9a7e-dbaceeae3b2e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:30.321377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561825-443d-44b5-9a7e-dbaceeae3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:30.387038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1e561825-443d-44b5-9a7e-dbaceeae3b2e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:30.388247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1e561825-443d-44b5-9a7e-dbaceeae3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:30.483185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 657/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:30.769675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:30.771204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:30.810814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:30.873505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ad80-c740-45c5-a8a0-896d9a47b909 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:30.945165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:30.945717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:30.945995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:30.946268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:30.948462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:31.028547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:31.053461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:31.054883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9f293-3cee-4cf6-91a8-7e41ceab4c61 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:31.073322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 680/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:33.685539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:33.686068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:33.686068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:33.687344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 658/1338] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:33.692451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d728-b32c-49f4-b1e5-403288092a24 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:33.692897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d728-b32c-49f4-b1e5-403288092a24 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:33.693036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d728-b32c-49f4-b1e5-403288092a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:33.759192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a602d728-b32c-49f4-b1e5-403288092a24 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:33.760870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a602d728-b32c-49f4-b1e5-403288092a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:33.860227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 681/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:34.146637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:34.148216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:34.227749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:34.255498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522abfcd-05fe-46b6-ba31-dfa06f2265ef None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:34.327105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:34.327709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:34.327990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:34.328263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:34.329875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:34.435038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:34.436396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeb74c-865b-479e-8a6d-3fe00c273039 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:34.454300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 659/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:38.606818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:38.607369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:38.607369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:38.608644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 682/1341] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:38.614086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346bca-df7b-4611-9def-24aedb7e4019 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:38.614564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346bca-df7b-4611-9def-24aedb7e4019 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:38.614667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346bca-df7b-4611-9def-24aedb7e4019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:38.620148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:38.680645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6a346bca-df7b-4611-9def-24aedb7e4019 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:38.681776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6a346bca-df7b-4611-9def-24aedb7e4019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:38.778296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 660/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:39.068621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:39.070313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:39.117939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:39.171965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59823bb-259c-498a-ae1a-7b068f40dc7c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:39.247506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:39.248103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:39.248377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:39.248644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:39.250325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:39.350390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:39.367432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:39.369541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc7a1c-f906-489b-906e-0cdc7c4d7561 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:39.387116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 683/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:42.182252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:42.182799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:42.183052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:42.185257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 661/1344] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:42.189841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7544c-e6e9-4df3-aeed-3c242855fbf5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:42.190316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7544c-e6e9-4df3-aeed-3c242855fbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:42.190407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7544c-e6e9-4df3-aeed-3c242855fbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:42.264177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-96e7544c-e6e9-4df3-aeed-3c242855fbf5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:42.265765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-96e7544c-e6e9-4df3-aeed-3c242855fbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:42.384930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 684/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:42.669859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:42.671487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:42.764067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:42.785296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fde84-63ef-4880-bab7-558c9cb86be5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:42.858300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:42.858816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:42.859092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:42.859358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:42.861181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:42.971170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:42.972643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a39ed2-8900-48f7-a4de-ac12fcc69c56 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:42.996014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 662/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:47.414151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:47.414675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:47.414675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:47.416036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 685/1347] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:47.422576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cec8-17d5-4d26-b48f-51e2f86d86be None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:47.423022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cec8-17d5-4d26-b48f-51e2f86d86be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:47.423124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0cec8-17d5-4d26-b48f-51e2f86d86be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:47.440996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:47.497701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e5b0cec8-17d5-4d26-b48f-51e2f86d86be None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:47.499170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5b0cec8-17d5-4d26-b48f-51e2f86d86be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:47.605791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 663/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:47.890801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:03:47.892350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:47.950192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:47.995610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1461be5-51ec-4032-937e-159ff3e63ce2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:03:48.068630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:03:48.069260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:48.069549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:48.069827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:48.071736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:48.175523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:48.179576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:03:48.181058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee286-3427-4df5-92a8-7cd02386cc4c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:03:48.198943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 686/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:03:53.074155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ac979-9d3a-415a-b628-63d699f445c9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:53.074577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ac979-9d3a-415a-b628-63d699f445c9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:53.074714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ac979-9d3a-415a-b628-63d699f445c9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:53.076250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 664/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:53.081639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1f52-b1a4-4f6f-b44a-45c1c203fc02 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:53.082509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1f52-b1a4-4f6f-b44a-45c1c203fc02 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:53.082952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1f52-b1a4-4f6f-b44a-45c1c203fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:53.183578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b7ca1f52-b1a4-4f6f-b44a-45c1c203fc02 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:53.185141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b7ca1f52-b1a4-4f6f-b44a-45c1c203fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:53.346092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 687/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:03:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:57.459982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b42de-f405-47e8-9d5b-800b814e1426 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:57.460561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b42de-f405-47e8-9d5b-800b814e1426 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:57.460561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b42de-f405-47e8-9d5b-800b814e1426 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:57.462073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 665/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:57.467708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20d27-ad3c-4d9e-b211-32fbdb004dc8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:57.468468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20d27-ad3c-4d9e-b211-32fbdb004dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:57.468932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20d27-ad3c-4d9e-b211-32fbdb004dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:57.534623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:57.564045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-faf20d27-ad3c-4d9e-b211-32fbdb004dc8 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:57.565413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-faf20d27-ad3c-4d9e-b211-32fbdb004dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:57.604136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=59 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:57.678944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 688/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:03:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:03:58.968265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12270-b390-4428-b586-31255be0aa36 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:58.968809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12270-b390-4428-b586-31255be0aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:58.968952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12270-b390-4428-b586-31255be0aa36 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:58.970422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 666/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:03:58.975581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a39b-5361-4639-a583-aa979f657dd1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:03:58.976004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a39b-5361-4639-a583-aa979f657dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:03:58.976253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a39b-5361-4639-a583-aa979f657dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:03:59.053013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e723a39b-5361-4639-a583-aa979f657dd1 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:03:59.054168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e723a39b-5361-4639-a583-aa979f657dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:03:59.096241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:03:59.161651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 689/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:02.851126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b757-644a-4899-9d47-53547e501f90 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:02.851702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b757-644a-4899-9d47-53547e501f90 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:02.851702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97b757-644a-4899-9d47-53547e501f90 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:02.853555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 667/1356] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:02.858900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb89-15fe-4df6-9939-8634f16d6148 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:02.859327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb89-15fe-4df6-9939-8634f16d6148 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:02.859432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb89-15fe-4df6-9939-8634f16d6148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:02.928032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7cc5eb89-15fe-4df6-9939-8634f16d6148 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:02.929328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7cc5eb89-15fe-4df6-9939-8634f16d6148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:03.036783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 690/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:03.336664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:03.337963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:03.338591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:03.340846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 668/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:04:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:03.348951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afe8a-95b6-4394-9b3e-7224e61d33b5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:03.349772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afe8a-95b6-4394-9b3e-7224e61d33b5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:03.350282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948afe8a-95b6-4394-9b3e-7224e61d33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:03.372233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:03.435986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-948afe8a-95b6-4394-9b3e-7224e61d33b5 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:03.437179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-948afe8a-95b6-4394-9b3e-7224e61d33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:03.566161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 691/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:04:03.566683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:03.568657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:03.728174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c22d09-ac67-4c8e-b1f4-0d7557aca0c6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:03.813528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:03.855147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:03.855836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:03.856192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:03.856534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:03.858211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:03.959254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:03.960965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe4f08-1ba3-4b55-8e2c-9ff86ddaa48f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:03.979804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 669/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:04:06.357748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:06.358175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:06.358385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:06.369563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 692/1361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:06.369832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146605f-1c8e-421d-a6b8-4dbdeee89dcd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:06.369832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146605f-1c8e-421d-a6b8-4dbdeee89dcd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:06.369832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146605f-1c8e-421d-a6b8-4dbdeee89dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:06.443009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1146605f-1c8e-421d-a6b8-4dbdeee89dcd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:06.444458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1146605f-1c8e-421d-a6b8-4dbdeee89dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:06.491856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:06.554259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 670/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:06.852067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:06.854300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:06.931487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.045438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d2bb-b61d-4ecc-a4b9-a0063df8557e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:07.192434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:07.193080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:07.193410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:07.193688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:07.195307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:07.219202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:07.290385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:07.292129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54931a1-9599-4d78-8e91-7ffb20b366d4 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:07.310904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 693/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:09.793148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83a2a5-0130-4a39-94f5-2de68b0902b7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:09.793685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83a2a5-0130-4a39-94f5-2de68b0902b7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:09.793771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83a2a5-0130-4a39-94f5-2de68b0902b7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:09.795067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 671/1364] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:09.800390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d885-b85a-40d6-b6cd-89704f5e73fb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:09.800793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d885-b85a-40d6-b6cd-89704f5e73fb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:09.801020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d885-b85a-40d6-b6cd-89704f5e73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:09.868004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8e63d885-b85a-40d6-b6cd-89704f5e73fb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:09.869396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8e63d885-b85a-40d6-b6cd-89704f5e73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:09.968733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:09.971393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 694/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:10.261919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:10.262397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:10.262783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:10.265582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 672/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:10.271051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860804-d8d7-4567-b694-eb710db61b9d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:10.271341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860804-d8d7-4567-b694-eb710db61b9d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:10.271619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860804-d8d7-4567-b694-eb710db61b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:10.348583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-dc860804-d8d7-4567-b694-eb710db61b9d None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:10.349798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dc860804-d8d7-4567-b694-eb710db61b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:10.473561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 695/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:04:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:10.482057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:10.483559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:10.639483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60d02-1b89-4215-8380-8413ad3c50f7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:10.660868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:10.768769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:10.769411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:10.769689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:10.769959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:10.771565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:10.871455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:10.873362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12ffdd-964c-4c13-a283-9b18edbc8de4 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:10.897357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 673/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:04:10.988837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d0c5-eea1-4242-8e45-e9e90e625c57 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:10.989447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d0c5-eea1-4242-8e45-e9e90e625c57 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:10.989447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0d0c5-eea1-4242-8e45-e9e90e625c57 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:10.991135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 696/1369] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:10.997822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9fad-eda9-4793-806c-4d97d4d8ba30 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:10.998110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9fad-eda9-4793-806c-4d97d4d8ba30 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:10.998386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9fad-eda9-4793-806c-4d97d4d8ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:11.035751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:11.082240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fe8b9fad-eda9-4793-806c-4d97d4d8ba30 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:11.084150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe8b9fad-eda9-4793-806c-4d97d4d8ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:11.202978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 674/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:04:11.544027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:11.544324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:11.544602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:11.549911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 697/1371] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 5 14:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:11.551497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cde1-d42d-4314-9e2b-448df18724dd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:11.551787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cde1-d42d-4314-9e2b-448df18724dd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:11.552061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889cde1-d42d-4314-9e2b-448df18724dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:11.639327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b889cde1-d42d-4314-9e2b-448df18724dd None None] MFA Rules not processed for user `35ef931ea9f54d2b85df3bb3f6158b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:11.640542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b889cde1-d42d-4314-9e2b-448df18724dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:11.690951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:11.723997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 675/1372] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 5 14:04:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:11.731626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:11.733592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:11.796136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:11.855329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343673e-4694-4614-b1d5-8828c180fe2a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:11.944474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:11.945375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:11.945861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:11.946485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:11.949377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:12.053385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:12.068315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:12.069358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2895-0c59-464f-97ee-a69bf1ce25f0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:12.089087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 698/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:13.144038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:13.144606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:13.144714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:13.146027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 676/1374] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:13.151314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a43a-3e31-47ef-88ce-c038fe926e78 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:13.151721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a43a-3e31-47ef-88ce-c038fe926e78 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:13.151989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5a43a-3e31-47ef-88ce-c038fe926e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:13.218467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d7a5a43a-3e31-47ef-88ce-c038fe926e78 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:13.219797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d7a5a43a-3e31-47ef-88ce-c038fe926e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:13.317027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 699/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:13.613895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:13.615447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:13.770318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaeb60c-b04c-49de-85eb-105809fbccd4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:13.832583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:13.896333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:13.896943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:13.897233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:13.897523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:13.899121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:13.994679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:13.996278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536915-2268-4457-8324-4b8029c475f5 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:14.015424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 677/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:16.249549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:16.250082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:16.250082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:16.251586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 700/1377] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:16.256813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa99f-d532-46df-a71c-ce4e0bf3c6ca None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:16.257363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa99f-d532-46df-a71c-ce4e0bf3c6ca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:16.257459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa99f-d532-46df-a71c-ce4e0bf3c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:16.327493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-439fa99f-d532-46df-a71c-ce4e0bf3c6ca None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:16.328819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-439fa99f-d532-46df-a71c-ce4e0bf3c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:16.338630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:16.436946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 678/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:16.736192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:16.738697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:16.811777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:16.901019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97177-8061-4839-9a62-0d4652408609 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:17.019345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:17.020118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:17.020525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:17.020904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:17.022663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:17.042673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:17.119332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:17.121099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c555e2-b91e-4846-a2d1-9e09f1a390d4 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:17.142420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 701/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:19.367714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:19.368169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:19.368287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:19.369667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 679/1380] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:19.375056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713e35-02b2-4b04-9a7e-aaa798771ce0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:19.375513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713e35-02b2-4b04-9a7e-aaa798771ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:19.375806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713e35-02b2-4b04-9a7e-aaa798771ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:19.449811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-24713e35-02b2-4b04-9a7e-aaa798771ce0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:19.450988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-24713e35-02b2-4b04-9a7e-aaa798771ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:19.587095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:19.593778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 702/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:19.904870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:19.906445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:20.043359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:20.053822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e8b4f-5c79-48b9-9d41-53756148e4de None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:20.168339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:20.168918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:20.169194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:20.169508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:20.171258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:20.261790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:20.263382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce81a4-0a3e-427d-8539-47da5fe300c2 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:20.273178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:20.282402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 680/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:22.800759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:22.801286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:22.801405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:22.802830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 703/1383] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:22.809125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809328b-3053-4529-bcbd-52147fba48d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:22.809615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809328b-3053-4529-bcbd-52147fba48d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:22.809823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809328b-3053-4529-bcbd-52147fba48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:22.881906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f809328b-3053-4529-bcbd-52147fba48d5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:22.883143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f809328b-3053-4529-bcbd-52147fba48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:22.983957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 681/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:23.288126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:23.289689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:23.438571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a90925-ff73-49bb-9f12-485cc32a3417 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:23.509021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:23.557554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:23.558196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:23.558504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:23.558792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:23.560468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:23.653744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:23.655578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d96223-3ee4-485d-b024-a963ab9bfb98 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:23.674323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 704/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:25.901646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:25.902190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:25.902190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:25.903533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 682/1386] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:25.909058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a0647-fef3-4e45-9758-133b4cd0c26e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:25.909533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a0647-fef3-4e45-9758-133b4cd0c26e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:25.909666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a0647-fef3-4e45-9758-133b4cd0c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:25.980873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-395a0647-fef3-4e45-9758-133b4cd0c26e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:25.982130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-395a0647-fef3-4e45-9758-133b4cd0c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:26.016482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:26.081704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 705/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:26.389598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:26.391124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:26.477466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:26.550426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800aca-0282-433d-b4cc-94269e6682d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:26.682976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:26.683652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:26.684005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:26.684367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:26.686421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:26.732284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:26.789349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:26.791534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef420cf-8c2e-4393-8721-37f881756ab0 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:26.811979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 683/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:29.367398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:29.367942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:29.368060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:29.369413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 706/1389] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:29.374807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d19fe-ff7a-4452-a95e-24c9358bcc8b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:29.375246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d19fe-ff7a-4452-a95e-24c9358bcc8b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:29.375383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d19fe-ff7a-4452-a95e-24c9358bcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:29.441383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d65d19fe-ff7a-4452-a95e-24c9358bcc8b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:29.442571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d65d19fe-ff7a-4452-a95e-24c9358bcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:29.539171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 684/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:29.829187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:29.830781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:29.974531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322c202-6d4e-429e-8b80-dfd694732fce None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:29.990865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:30.090061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:30.090576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:30.090849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:30.091126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:30.092710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:30.181072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:30.183262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf48858-6113-47b8-99ab-12886a895d7d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:30.201756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 707/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:31.047661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881962-e48a-4de9-b662-6e3bf7b87a81 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:31.048222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881962-e48a-4de9-b662-6e3bf7b87a81 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:31.048222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881962-e48a-4de9-b662-6e3bf7b87a81 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:31.049822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 685/1392] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:31.054942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f05a-f6a3-4326-8e49-3f237cf2c89f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:31.055350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f05a-f6a3-4326-8e49-3f237cf2c89f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:31.055556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21f05a-f6a3-4326-8e49-3f237cf2c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:31.080409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:31.125146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ee21f05a-f6a3-4326-8e49-3f237cf2c89f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:31.126363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ee21f05a-f6a3-4326-8e49-3f237cf2c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:31.221826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 708/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:31.523400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:31.523758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:31.524130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:31.525571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 686/1394] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 5 14:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:31.530858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ba0b-3c7d-4634-8393-61cb61fb461d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:31.531149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ba0b-3c7d-4634-8393-61cb61fb461d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:31.531426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00ba0b-3c7d-4634-8393-61cb61fb461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:31.606528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ed00ba0b-3c7d-4634-8393-61cb61fb461d None None] MFA Rules not processed for user `1a782cf2bac541d9b83a99b77fafb9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:31.607642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed00ba0b-3c7d-4634-8393-61cb61fb461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:31.648454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:31.684866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 709/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 5 14:04:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:04:31.694027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:31.695567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:31.710015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:31.801580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d0f9-f68a-441c-b618-8bc2c7fd8037 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:31.876585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:31.877097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:31.877406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:31.877679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:31.879261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:31.947472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:31.989097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:31.990551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8a84d-ca0e-46b4-b08b-48353c6927e2 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:32.009199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 687/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:32.392397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576641-760b-4ab5-90d9-b76f18ef9be3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:32.392917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576641-760b-4ab5-90d9-b76f18ef9be3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:32.393158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576641-760b-4ab5-90d9-b76f18ef9be3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:32.394519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 710/1397] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:32.400686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:32.401632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:32.402133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:32.480167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:32.481397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:32.579712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 688/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:32.774758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccff8d0-6493-447a-b330-62fe72d23080 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:32.775040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccff8d0-6493-447a-b330-62fe72d23080 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:32.775869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccff8d0-6493-447a-b330-62fe72d23080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:32.842963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fccff8d0-6493-447a-b330-62fe72d23080 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:32.844165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fccff8d0-6493-447a-b330-62fe72d23080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:32.875165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:32.876461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:32.903357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:32.930651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 711/1399] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:32.974954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb107-f5e4-4aaf-bcd4-b924f4617568 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:32.975268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb107-f5e4-4aaf-bcd4-b924f4617568 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:32.975547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cb107-f5e4-4aaf-bcd4-b924f4617568 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:32.977165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 712/1400] 10.222.0.16 () {54 vars in 943 bytes} [Wed Oct 5 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 14:04:32.983121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:32.983405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:32.983684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:32.994696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7eac7-eea6-4138-8709-2894779e50dc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:33.057498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:33.066336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] MFA Rules not processed for user `79c09cbdb8dd45f49e430fbf5fe59e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:33.067305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:33.113998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:33.114630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:33.114911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:33.115185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:33.116782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:33.136650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:33.176579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 713/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 5 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:04:33.187012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:33.196477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4403-555b-41e6-9f75-4b4bc228fbab None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:33.209213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:33.210878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78151-fb4f-410f-a1ff-e3e8991055e0 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:33.235037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 689/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:04:33.325292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:33.325925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:33.326207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:33.326476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:33.328232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:33.331102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:33.422928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:33.424559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add6b6a-87f2-4b13-9064-e5f6bf2f74a1 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:33.434211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 714/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 14:04:35.495345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:35.495904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:35.495904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:35.501376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 690/1404] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:35.502760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c5ada-e177-4f4d-bcf4-5b0d9dd83d9c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:35.503239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c5ada-e177-4f4d-bcf4-5b0d9dd83d9c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:35.503339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c5ada-e177-4f4d-bcf4-5b0d9dd83d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:35.599536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-db0c5ada-e177-4f4d-bcf4-5b0d9dd83d9c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:35.601067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-db0c5ada-e177-4f4d-bcf4-5b0d9dd83d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:35.727586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:35.734913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 715/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:04:36.031906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:36.033574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:36.202390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:36.204685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e60498-2244-4986-845f-dfbdf9b558cb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:36.339122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:36.339852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:36.340209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:36.340573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:36.342275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:36.444379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:36.446032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329599-4589-4e00-8a28-5e6d86ed4181 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:36.466777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 691/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:38.710201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:38.710740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:38.710740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:38.712109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 716/1407] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:38.718286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad383f4-2c21-4617-85cd-20f7f8794305 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:38.718719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad383f4-2c21-4617-85cd-20f7f8794305 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:38.718803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad383f4-2c21-4617-85cd-20f7f8794305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:38.723270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:38.795159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2ad383f4-2c21-4617-85cd-20f7f8794305 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:38.796391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2ad383f4-2c21-4617-85cd-20f7f8794305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:38.938795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 692/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:39.231471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:39.232998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:39.397901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ccf61-cc79-4f24-8a9c-d9e8c9939664 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:39.470708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:39.524268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:39.525023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:39.525888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:39.526169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:39.528057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:39.629644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:39.631373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92185b-871c-4599-81ca-5a1122fa861f service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:04:39.652350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 717/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:04:48.936981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=64 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:49.648613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=64 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:56.093475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bcbd4-293d-4039-8b3e-dbca9a59cf75 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:56.094014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bcbd4-293d-4039-8b3e-dbca9a59cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:56.094014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bcbd4-293d-4039-8b3e-dbca9a59cf75 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:56.095293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 693/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 5 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:56.100487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534395-ecac-42d9-b32b-2ada4a681c3f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:56.100912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534395-ecac-42d9-b32b-2ada4a681c3f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:56.101024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534395-ecac-42d9-b32b-2ada4a681c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:56.175521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bb534395-ecac-42d9-b32b-2ada4a681c3f None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:56.176747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bb534395-ecac-42d9-b32b-2ada4a681c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:56.281045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 718/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 5 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:56.296081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f763-b75c-4486-af31-f21ef88e8f0c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:56.296367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f763-b75c-4486-af31-f21ef88e8f0c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:56.296638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7f763-b75c-4486-af31-f21ef88e8f0c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:56.297985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 694/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 5 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:56.302587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcb59-6878-4695-917e-e444d3f5effb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:56.302871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcb59-6878-4695-917e-e444d3f5effb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:56.303171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfcb59-6878-4695-917e-e444d3f5effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:56.374658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:56.377275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-31cfcb59-6878-4695-917e-e444d3f5effb None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:56.379009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-31cfcb59-6878-4695-917e-e444d3f5effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:56.490321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 719/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 5 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:59.065659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:59.066186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:59.066186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:59.067446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:04:59.072659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801c4d9-adf6-49b8-9472-faf0c3cf12e1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:59.073091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801c4d9-adf6-49b8-9472-faf0c3cf12e1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:59.073266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801c4d9-adf6-49b8-9472-faf0c3cf12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:59.255729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f801c4d9-adf6-49b8-9472-faf0c3cf12e1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:04:59.256931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f801c4d9-adf6-49b8-9472-faf0c3cf12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:59.310424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:59.351022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:04:59.643660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:04:59.645171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:59.787635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf6698-f150-47d4-aea2-8f4264e5664a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:04:59.859503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:04:59.900083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:04:59.901169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:04:59.901485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:04:59.901757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:04:59.903355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:04:59.991136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:04:59.992728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846fd1c-e603-4c53-9978-68d99a512da1 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:00.011711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 696/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:01.154345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:01.154938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:01.154938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:01.156271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:01.162543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8618ab-d8b5-41a5-a727-6b66fb90a53e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:01.162985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8618ab-d8b5-41a5-a727-6b66fb90a53e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:01.163091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8618ab-d8b5-41a5-a727-6b66fb90a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:01.238149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef8618ab-d8b5-41a5-a727-6b66fb90a53e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:01.239608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef8618ab-d8b5-41a5-a727-6b66fb90a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:01.266177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:01.333999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:01.495973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:01.497520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:01.643940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d5884-53be-485b-960d-f0f5a90b17f5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:01.682751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:01.753611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:01.754137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:01.754412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:01.754682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:01.756253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:01.843326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:01.844913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d1dde-6a1c-4111-a4f8-c574bee1b5bc service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:01.862547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 722/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:03.007810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:03.008376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:03.008483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:03.009876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:03.016618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638fcd-5a2b-4d61-bd85-0089145d30b6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:03.017093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638fcd-5a2b-4d61-bd85-0089145d30b6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:03.017204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638fcd-5a2b-4d61-bd85-0089145d30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:03.070757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:03.092920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-19638fcd-5a2b-4d61-bd85-0089145d30b6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:03.094164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-19638fcd-5a2b-4d61-bd85-0089145d30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:03.188372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:03.340363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:03.341915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:03.489273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08c6e-ecdb-400c-becd-e312cd84f98b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:03.502197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:03.602934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:03.603463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:03.603762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:03.604032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:03.605700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:03.693199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:03.694813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69491cd-b858-4338-9de5-9da34cb0070a service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:03.712727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 699/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:04.816010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:04.816513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:04.816513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:04.817876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:04.824110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6442-27e4-45a3-9c8b-03117db4e96d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:04.824531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6442-27e4-45a3-9c8b-03117db4e96d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:04.824673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6442-27e4-45a3-9c8b-03117db4e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:04.844551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:04.901502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-949d6442-27e4-45a3-9c8b-03117db4e96d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:04.902712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-949d6442-27e4-45a3-9c8b-03117db4e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:04.998100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:05.148473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:05.150037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:05.258399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:05.293858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b99b8-4d6c-4892-b7fa-01fda1b9ceba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:05.405394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:05.405937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:05.406213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:05.406480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:05.408051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:05.481675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:05.496935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:05.498578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea1616-07fa-4e3b-863a-d3aebf69142c service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:05.516626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 725/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:06.622268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:06.622843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:06.622843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:06.624162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:06.630326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca36-a394-478f-bc50-0a371a1930f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:06.630765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca36-a394-478f-bc50-0a371a1930f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:06.630875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ca36-a394-478f-bc50-0a371a1930f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:06.705715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1605ca36-a394-478f-bc50-0a371a1930f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:06.706911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1605ca36-a394-478f-bc50-0a371a1930f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:06.803978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:06.954872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:06.956313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:07.040221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:07.100766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff2151-e3be-4096-b57e-b6176c446a3c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:07.212299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:07.212821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:07.213099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:07.213402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:07.214977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:07.262801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:07.303381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:07.304969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1caeec-e1b1-4682-9d3e-f999bbf302f5 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:07.323076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 702/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:08.375367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:08.375902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:08.375902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:08.377248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:08.383520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896fe0-c9d6-4678-b86c-823f7d4f5e37 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:08.383979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896fe0-c9d6-4678-b86c-823f7d4f5e37 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:08.384088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896fe0-c9d6-4678-b86c-823f7d4f5e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:08.458740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3e896fe0-c9d6-4678-b86c-823f7d4f5e37 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:08.459949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3e896fe0-c9d6-4678-b86c-823f7d4f5e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:08.555945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:08.706047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:08.707525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:08.759032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:08.857856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbab03-645e-48f5-b406-d87fd68105ce None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:08.971676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:08.972207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:08.972487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:08.972759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:08.974419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:08.981155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:09.061725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:09.063305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b316a-4eaf-4c99-938b-90d7fe73493f service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:09.081036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 728/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:10.133040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:10.133591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:10.133591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:10.135462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:10.141606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6039ef-1cd5-4385-acbb-7e3aa447e099 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:10.142035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6039ef-1cd5-4385-acbb-7e3aa447e099 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:10.142151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6039ef-1cd5-4385-acbb-7e3aa447e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:10.216331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3d6039ef-1cd5-4385-acbb-7e3aa447e099 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:10.217563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3d6039ef-1cd5-4385-acbb-7e3aa447e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:10.284342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:10.312029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:10.459565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:10.461034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:10.479200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:10.604571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6690b3-15ec-4368-bc65-aa3efe872324 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:10.692018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:10.718602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:10.719146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:10.719423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:10.719692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:10.721313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:10.809423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:10.811038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756072a-d76d-41c7-a7bc-2135140a8a49 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:10.829090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 705/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:11.872928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:11.873500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:11.873500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:11.874847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:11.880819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe133-31e9-4b57-a426-75ffea727e55 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:11.881254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe133-31e9-4b57-a426-75ffea727e55 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:11.881404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe133-31e9-4b57-a426-75ffea727e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:11.956122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-69dfe133-31e9-4b57-a426-75ffea727e55 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:11.957526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-69dfe133-31e9-4b57-a426-75ffea727e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:12.000208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:12.054883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:12.202354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:12.203907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:12.351205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0f72-60ff-406b-8293-847f6d65745d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:12.405872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:12.462205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:12.462805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:12.463674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:12.463943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:12.465546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:12.552075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:12.553764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9660803-baac-4a37-8d2f-53abbba719d4 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:12.571261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 731/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:13.633796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:13.634369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:13.634369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:13.636273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:13.642472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf203-c8b8-4219-82d8-6e4ab226b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:13.642917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf203-c8b8-4219-82d8-6e4ab226b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:13.643015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf203-c8b8-4219-82d8-6e4ab226b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:13.717465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-849bf203-c8b8-4219-82d8-6e4ab226b2e2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:13.718672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-849bf203-c8b8-4219-82d8-6e4ab226b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:13.720631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:13.814764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:13.963087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:13.964533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:14.108435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4a6d9-47d8-42ba-8c6a-8a9a2f66605e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:14.136527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:14.219942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:14.220466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:14.220744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:14.221016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:14.222643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:14.309978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:14.311561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb48ee-1bda-4159-88b0-cf7a782a0646 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:14.328920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 708/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:16.374735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:16.375300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:16.375300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:16.376626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:16.382140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77c67-44c4-4eea-8321-443cc9c90644 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:16.382556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77c67-44c4-4eea-8321-443cc9c90644 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:16.382727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b77c67-44c4-4eea-8321-443cc9c90644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:16.424535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:16.449954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b0b77c67-44c4-4eea-8321-443cc9c90644 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:16.451181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b0b77c67-44c4-4eea-8321-443cc9c90644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:16.547171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:16.833530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:16.835096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:16.936671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b72f8-395b-46f5-af1a-8e995eb6cd9e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:16.968810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:17.011011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:17.011616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:17.011891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:17.012158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:17.013753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:17.120113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:17.121495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585e014-7730-4e46-94d9-0a2636b5c89e service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:17.139701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 734/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:19.421633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:19.422162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:19.422162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:19.423590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:19.428678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c37f-d3a5-4966-bb19-364ca0327409 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:19.429088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c37f-d3a5-4966-bb19-364ca0327409 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:19.429259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c37f-d3a5-4966-bb19-364ca0327409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:19.496504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1ce8c37f-d3a5-4966-bb19-364ca0327409 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:19.497755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1ce8c37f-d3a5-4966-bb19-364ca0327409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:19.510371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:19.593584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:19.877624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:19.879176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:19.981723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5436ca6-bf8c-4aa6-81da-5b7fdd81a52a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:19.995058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:20.058698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:20.059219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:20.059499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:20.059773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:20.061404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:20.169271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:20.170717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa08d6-945f-45e2-b311-47c25f22ac17 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:20.188821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 711/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:22.616947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:22.617541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:22.617541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:22.618866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:22.624621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ccd1-27d7-40e6-af3e-54e4e56a5758 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:22.625556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ccd1-27d7-40e6-af3e-54e4e56a5758 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:22.625556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ccd1-27d7-40e6-af3e-54e4e56a5758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:22.672772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:22.691127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5ba4ccd1-27d7-40e6-af3e-54e4e56a5758 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:22.692326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ba4ccd1-27d7-40e6-af3e-54e4e56a5758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:22.788264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:23.070176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:23.071725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:23.172472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc03b24-d184-4cc1-b303-543d4f744fbc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:23.211304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:23.247841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:23.248441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:23.248717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:23.248984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:23.250592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:23.355736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:23.357171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cda343-ded7-4cae-8afe-66c7399248c6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:23.374642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 737/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:25.624903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:25.625443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:25.625443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:25.626779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:25.632249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec04-ce76-474c-a76d-726da868c792 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:25.632653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec04-ce76-474c-a76d-726da868c792 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:25.632806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62ec04-ce76-474c-a76d-726da868c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:25.699128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ef62ec04-ce76-474c-a76d-726da868c792 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:25.700337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ef62ec04-ce76-474c-a76d-726da868c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:25.719914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:25.794851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:26.077352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:26.078962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:26.180874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262feb7f-5c8e-4508-811c-90919a5dd7bd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:26.201507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:26.255018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:26.255637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:26.255917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:26.256181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:26.257784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:26.364109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:26.365756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fe4f9-9ab3-41e3-b106-7d5c19d5f325 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:26.383087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 714/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:28.568714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:28.569305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:28.569305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:28.570612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:28.577273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189044-c540-4cd0-945d-d4fb0acc8e7b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:28.577703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189044-c540-4cd0-945d-d4fb0acc8e7b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:28.577985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189044-c540-4cd0-945d-d4fb0acc8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:28.641353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:28.644280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d1189044-c540-4cd0-945d-d4fb0acc8e7b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:28.646300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1189044-c540-4cd0-945d-d4fb0acc8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:28.739242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:29.022866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:29.024404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:29.126771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971ba7e-b36d-4db9-9dba-296a548fe83f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:29.174669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:29.198867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:29.199463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:29.199738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:29.200006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:29.201607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:29.307675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:29.309051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03603b-6ab2-48b6-98f1-86ca112e670b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:29.326336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 740/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:31.556229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:31.556802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:31.556802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:31.558250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:31.563557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5a246-f3d0-428c-bbf1-7fc6202a9657 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:31.563976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5a246-f3d0-428c-bbf1-7fc6202a9657 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:31.564098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5a246-f3d0-428c-bbf1-7fc6202a9657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:31.628673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-41d5a246-f3d0-428c-bbf1-7fc6202a9657 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:31.629812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-41d5a246-f3d0-428c-bbf1-7fc6202a9657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:31.658293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:31.724378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:32.006289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:32.007873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:32.108504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15843152-543b-430f-a64d-69aae462f0d8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:32.137863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:32.183365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:32.183972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:32.184251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:32.184529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:32.186168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:32.294386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:32.295755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec3195-faca-45f6-8d17-da7fd383c852 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:32.429056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 717/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:34.623913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:34.624526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:34.624526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:34.625839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:34.631353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20bc5-a1ae-44ac-8d67-837a7c3d8dc4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:34.631808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20bc5-a1ae-44ac-8d67-837a7c3d8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:34.631932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf20bc5-a1ae-44ac-8d67-837a7c3d8dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:34.700068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8bf20bc5-a1ae-44ac-8d67-837a7c3d8dc4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:34.702144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8bf20bc5-a1ae-44ac-8d67-837a7c3d8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:34.710580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:34.799257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:35.085749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:35.087318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:35.187919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b833df-6c19-411a-8fd7-6db953ff2ff8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:35.242398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:35.261658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:35.262259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:35.262538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:35.262811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:35.264408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:35.375036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:35.376489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e96a7b-123d-45b0-9fe7-85079d9e4bc9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:35.394902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 743/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:37.660228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:37.660747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:37.660747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:37.662067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:37.668074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500ac80-1356-4f52-aa86-cf890d218be2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:37.668522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500ac80-1356-4f52-aa86-cf890d218be2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:37.668640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500ac80-1356-4f52-aa86-cf890d218be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:37.732399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e500ac80-1356-4f52-aa86-cf890d218be2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:37.733653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e500ac80-1356-4f52-aa86-cf890d218be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:37.771445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:37.829950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:38.114981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:38.116792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:38.222081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5c189-0f73-466b-8259-4b2e72818063 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:38.259791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:38.294531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:38.295130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:38.295410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:38.295680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:38.297296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:38.405695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:38.407094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fee1c4-125a-447c-ad82-2caa6e024300 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:38.424560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 720/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:40.592456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:40.593033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:40.593033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:40.594365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:40.599640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9cb0e-ef6e-4e68-a62b-1bd382ef4480 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:40.600039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9cb0e-ef6e-4e68-a62b-1bd382ef4480 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:40.600200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9cb0e-ef6e-4e68-a62b-1bd382ef4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:40.665252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f1f9cb0e-ef6e-4e68-a62b-1bd382ef4480 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:40.667037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f1f9cb0e-ef6e-4e68-a62b-1bd382ef4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:40.684526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:40.761895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:41.049578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:41.051171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:41.152959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761dcc7-3279-4dc5-b8f0-57b8dfcdd3b8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:41.220169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:41.227012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:41.227601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:41.227881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:41.228156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:41.229815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:41.337247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:41.338650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a20af-cbb5-48c5-933b-43401719846a service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:41.356619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 746/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:43.539371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:43.539933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:43.539933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:43.541916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:05:43.547230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7e02f-2e2d-4639-9fc9-9056472dccaa None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:43.547641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7e02f-2e2d-4639-9fc9-9056472dccaa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:43.547753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7e02f-2e2d-4639-9fc9-9056472dccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:43.616002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0ac7e02f-2e2d-4639-9fc9-9056472dccaa None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:05:43.617189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0ac7e02f-2e2d-4639-9fc9-9056472dccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:43.664387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:43.711758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:05:44.001104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:05:44.002656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:44.103786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1214a9-a566-49f2-b6d5-3e00973dc6f8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:05:44.149988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:44.175625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:05:44.176221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:05:44.176496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:05:44.176763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:05:44.178376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:05:44.290901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:05:44.292825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2d5fc-1525-4fa8-866a-dff5637f0fd7 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:05:44.310634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 723/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:05:53.710268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=22 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:05:54.308250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=66 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:04.193917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec118-43b4-4f9e-b091-c205f928fe2a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:04.194498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec118-43b4-4f9e-b091-c205f928fe2a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:04.194498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec118-43b4-4f9e-b091-c205f928fe2a None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:04.195725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 748/1471] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:04.201992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916463-e0c8-49e5-b897-392ddc22e61b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:04.202468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916463-e0c8-49e5-b897-392ddc22e61b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:04.202578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916463-e0c8-49e5-b897-392ddc22e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:04.271438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f6916463-e0c8-49e5-b897-392ddc22e61b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:04.272648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f6916463-e0c8-49e5-b897-392ddc22e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:04.367935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 724/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:04.663457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b981-25a2-4276-a957-84954ae22236 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:04.663746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b981-25a2-4276-a957-84954ae22236 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:04.664051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661b981-25a2-4276-a957-84954ae22236 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:04.665411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 749/1473] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 5 14:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:04.670826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf733-6020-4796-a436-e6fa8f56f8eb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:04.671139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf733-6020-4796-a436-e6fa8f56f8eb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:04.671411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf733-6020-4796-a436-e6fa8f56f8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:04.746201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8cddf733-6020-4796-a436-e6fa8f56f8eb None None] MFA Rules not processed for user `1a782cf2bac541d9b83a99b77fafb9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:04.747399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8cddf733-6020-4796-a436-e6fa8f56f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:04.767276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:04.822458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 725/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 5 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:04.830194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661b981-25a2-4276-a957-84954ae22236 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:04.831752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5661b981-25a2-4276-a957-84954ae22236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:04.935245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661b981-25a2-4276-a957-84954ae22236 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:05.006153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:05.006753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:05.007033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:05.007306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:05.008891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:05.062519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:05.117239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:05.118683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693584e1-7539-47b0-aca5-c46e702cd810 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:05.136989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 750/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:07.393923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:07.394412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:07.394519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:07.395816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 726/1476] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:07.401070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a227-b5ea-4cbc-bf83-ee31dfb7ed8c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:07.401515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a227-b5ea-4cbc-bf83-ee31dfb7ed8c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:07.401664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a227-b5ea-4cbc-bf83-ee31dfb7ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:07.466515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9c94a227-b5ea-4cbc-bf83-ee31dfb7ed8c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:07.467717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9c94a227-b5ea-4cbc-bf83-ee31dfb7ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:07.562506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 751/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:07.836573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:07.838684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:07.960076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d99b9e-1e45-477a-ae00-fee17de17e70 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:08.009424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:08.052657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:08.053191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:08.053514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:08.053779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:08.054412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:08.056126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:06:08.056126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:06:08.056126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:06:08.057301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f22bf-d5a4-4dd9-876c-83a8b0043fa2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:08.076084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 727/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 14:06:07 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:06:10.243983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25572-a974-4170-adbe-b43813b2812b None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:10.244837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25572-a974-4170-adbe-b43813b2812b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:10.244837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f25572-a974-4170-adbe-b43813b2812b None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:10.246062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 752/1479] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:10.251421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e5cc-3167-4e3f-940f-1ba266a442a9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:10.251865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e5cc-3167-4e3f-940f-1ba266a442a9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:10.251965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00e5cc-3167-4e3f-940f-1ba266a442a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:10.319353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1c00e5cc-3167-4e3f-940f-1ba266a442a9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:10.320542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1c00e5cc-3167-4e3f-940f-1ba266a442a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:10.416663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 728/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:10.712079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f25572-a974-4170-adbe-b43813b2812b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:10.714282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-12f25572-a974-4170-adbe-b43813b2812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:10.724126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:10.859051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f25572-a974-4170-adbe-b43813b2812b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:10.936252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:10.969173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:10.969750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:10.970032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:10.970308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:10.971925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:11.062531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:11.064406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0b009-efa3-4f1c-a242-89937c7b0b47 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:11.082490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 753/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:13.393139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:13.393631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:13.393734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:13.395059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 729/1482] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:13.400436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848127a2-e0ed-4a8c-adba-6e33796e16d2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:13.400874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848127a2-e0ed-4a8c-adba-6e33796e16d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:13.401022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848127a2-e0ed-4a8c-adba-6e33796e16d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:13.465282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-848127a2-e0ed-4a8c-adba-6e33796e16d2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:13.466487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-848127a2-e0ed-4a8c-adba-6e33796e16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:13.515331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:13.570956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 754/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:13.857592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:13.859134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:13.882477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:13.962561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab35638-b585-4b1b-a4ac-fab4d49b2991 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:14.034707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:14.035309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:14.035591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:14.035866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:14.037536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:14.110173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:14.144517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:14.145975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b2b9a-1768-4855-8de7-edd8075dc984 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:14.163735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 730/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:16.360283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:16.360864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:16.360864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:16.362212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 755/1485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:16.367841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca207c7-6f1f-4e20-a21e-0fcb2ae2005d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:16.368266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca207c7-6f1f-4e20-a21e-0fcb2ae2005d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:16.368379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca207c7-6f1f-4e20-a21e-0fcb2ae2005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:16.432549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1ca207c7-6f1f-4e20-a21e-0fcb2ae2005d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:16.433760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ca207c7-6f1f-4e20-a21e-0fcb2ae2005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:16.527428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 731/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:16.814226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:16.815761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:16.916713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529be6aa-7684-4e8d-8169-13d50efddf9d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:16.985957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:16.987375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:16.988054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:16.988524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:16.988801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:16.990807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:17.098179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:17.099546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1145c-d94b-43fb-83dc-0525e7c49c70 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:17.117322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 756/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:19.427190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:19.427700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:19.427700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:19.429005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 732/1488] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:19.434284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a493fd-11a3-47b6-aeeb-ada8589e2633 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:19.434674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a493fd-11a3-47b6-aeeb-ada8589e2633 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:19.434834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a493fd-11a3-47b6-aeeb-ada8589e2633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:19.501004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-64a493fd-11a3-47b6-aeeb-ada8589e2633 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:19.502232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-64a493fd-11a3-47b6-aeeb-ada8589e2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:19.553934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:19.597169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 757/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:19.893626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:19.895167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:19.930671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:19.998792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df92f-94c5-41e3-91d9-2dab80663384 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:20.070260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:20.070787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:20.071067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:20.071335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:20.072946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:20.151574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:20.181084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:20.183169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6326cf-7537-4e31-bb72-cffa755d673a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:20.201169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 733/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:22.574204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:22.574790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:22.574790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:22.576090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 758/1491] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 14:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:06:22.581458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372e27-e467-4184-9189-d61d780c7a35 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:22.581874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372e27-e467-4184-9189-d61d780c7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:22.582014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372e27-e467-4184-9189-d61d780c7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:22.646909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a4372e27-e467-4184-9189-d61d780c7a35 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:06:22.648054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a4372e27-e467-4184-9189-d61d780c7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:22.741394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 734/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:06:23.033573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:06:23.035112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:23.137341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f03ee-5a64-4902-8f90-79229ff12c58 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:06:23.208359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:06:23.208956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:06:23.209258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:06:23.209525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:06:23.211108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:06:23.220042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:23.321681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:06:23.323628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be8b40-1be5-458d-a5d4-710662d981ee service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:06:23.340980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 759/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:06:32.739870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=82 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:06:33.338845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=50 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:42.077302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:42.077890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:42.077890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:42.153525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:07:42.154733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:42.249398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 735/1494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:07:42.257391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:42.257896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:42.258004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:42.333010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:07:42.334246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:42.428938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 760/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:07:42.433611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:42.434813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:42.445964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989e45f-9e91-4c11-a35c-2be9fbd903fa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:42.506061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:42.540809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:42.541431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:42.541711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:42.541980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:42.542615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:07:42.542914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:42.543913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:42.543913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:07:42.543913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:07:42.544795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:42.555664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 736/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:07:42.564359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:42.573877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744cdf7-78c1-4772-811a-a7ede78e5f60 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:42.632746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:42.666948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:42.667583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:42.667862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:42.668134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:42.668759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:42.670527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:42.670527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:07:42.670527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:07:42.671725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:42.726245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 761/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:07:42 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:07:42.730552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:42.732118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:42.766320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5b3b-9852-4ab4-9d5d-c4e7777476fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:42.858788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:42.859386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:42.859663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:42.859935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:42.860581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:42.861592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:42.861592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:07:42.861592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:07:42.862796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:42.904473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 737/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:07:42 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:07:42.908728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:42.910262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:42.970494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405fe76-14ce-458c-bd23-b49afd42d845 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:43.052746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:43.063552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:43.064157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.064430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.064703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.065367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:43.066380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:43.066380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:07:43.066380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:07:43.067255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:43.081612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 762/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:07:43.085673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:43.087195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:43.099013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27ba54-11a3-4359-aaaf-47f0f9070b0d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:43.126200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:43.194409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:43.194934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.195211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.195486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.196116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:43.197639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:43.197639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:07:43.197639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:07:43.198516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8f92-44a3-4893-af1b-ed545e313f82 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:43.210435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 738/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:07:43.215204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:43.216748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:43.250464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3af0c-6130-4208-99af-cf8f967e905c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:43.346015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:43.346673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.346936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.347206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] PATH_INFO: `/v3/projects/ba9a9ddfc7474e21bb59764afc3f1da6/users/baf2ac0d80ad4f6a949c55be3ac4a832/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.369943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9a9ddfc7474e21bb59764afc3f1da6, user_id=baf2ac0d80ad4f6a949c55be3ac4a832, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:43.370977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:43.370977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:07:43.370977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:07:43.372945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b704453-1293-4327-86aa-6826ce3b2783 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:43.397912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 763/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:07:43 2022] PUT /identity/v3/projects/ba9a9ddfc7474e21bb59764afc3f1da6/users/baf2ac0d80ad4f6a949c55be3ac4a832/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:07:43.411236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e969-a737-490b-8365-a8fb9b79f648 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.411526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e969-a737-490b-8365-a8fb9b79f648 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.411802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e969-a737-490b-8365-a8fb9b79f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.469884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e186e969-a737-490b-8365-a8fb9b79f648 None None] MFA Rules not processed for user `baf2ac0d80ad4f6a949c55be3ac4a832`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:07:43.471003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e186e969-a737-490b-8365-a8fb9b79f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:43.553525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 739/1502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:07:43.563481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.563772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.564044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.565684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 764/1503] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 5 14:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:07:43.570796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6dd0f-32e6-49bf-aae0-fe460a10d41e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.571082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6dd0f-32e6-49bf-aae0-fe460a10d41e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.571361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6dd0f-32e6-49bf-aae0-fe460a10d41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.602903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:43.647920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3cc6dd0f-32e6-49bf-aae0-fe460a10d41e None None] MFA Rules not processed for user `35ef931ea9f54d2b85df3bb3f6158b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:07:43.649108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3cc6dd0f-32e6-49bf-aae0-fe460a10d41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:43.721549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 740/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 5 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:07:43.729283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:43.730847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:43.780846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:43.834332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2adec6-20be-4b64-8388-b3d1c086e4f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:43.905594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:43.906193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:43.906473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:43.906749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:43.908338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:44.005764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:44.007204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:44.010664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:44.024693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 765/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:07:44.070145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693080d-24fb-4422-94cf-a69b50263ce7 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:44.070435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693080d-24fb-4422-94cf-a69b50263ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:44.070713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693080d-24fb-4422-94cf-a69b50263ce7 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:44.071975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 741/1506] 10.222.0.16 () {52 vars in 830 bytes} [Wed Oct 5 14:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:07:44.075461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:44.076669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:44.175712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f376e-db66-4fe6-b060-e8e66596792d service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:44.267136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:44.267688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:44.267965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:44.268234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] PATH_INFO: `/v3/users/baf2ac0d80ad4f6a949c55be3ac4a832` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:44.281427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf2ac0d80ad4f6a949c55be3ac4a832)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:44.282487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:44.282487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:07:44.282487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:07:44.283699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:44.293770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:44.348260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf2ac0d80ad4f6a949c55be3ac4a832'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:44.371023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf2ac0d80ad4f6a949c55be3ac4a832'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:44.371477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf2ac0d80ad4f6a949c55be3ac4a832'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:44.380584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf2ac0d80ad4f6a949c55be3ac4a832'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:44.381133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf2ac0d80ad4f6a949c55be3ac4a832'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:44.399737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 766/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:07:44 2022] DELETE /identity/v3/users/baf2ac0d80ad4f6a949c55be3ac4a832 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:07:44.404678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:44.405156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:44.405283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:44.460640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:07:44.461878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:44.536000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:44.551494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 742/1508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:07:44.561288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:44.562502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:44.661831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710514f-87af-4dab-acac-1385cba78c70 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:44.715403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:44.735020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:44.735628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:44.735904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:44.736174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:44.737817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:44.850203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:44.851645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e45885-efc6-4c48-a85f-2c82b139a26d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:44.869815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 767/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:07:45.194729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:07:45.196006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:07:45.208045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b7a17-0b16-4257-ae8b-dfd04ceda26a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:07:45.308962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:07:45.309558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:07:45.309839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:07:45.310111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] PATH_INFO: `/v3/projects/ba9a9ddfc7474e21bb59764afc3f1da6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:07:45.319753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9a9ddfc7474e21bb59764afc3f1da6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:07:45.320777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:07:45.320777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:07:45.320777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:07:45.322692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:07:45.379679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9a9ddfc7474e21bb59764afc3f1da6', 'request_id': 'req-947a1864-9ed1-4cc5-8427-022546e93a7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:45.388863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9a9ddfc7474e21bb59764afc3f1da6', 'request_id': 'req-947a1864-9ed1-4cc5-8427-022546e93a7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:45.395018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9a9ddfc7474e21bb59764afc3f1da6', 'request_id': 'req-947a1864-9ed1-4cc5-8427-022546e93a7c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:45.428762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] The token cache is being invalidate because project ba9a9ddfc7474e21bb59764afc3f1da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:07:45.429338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:45.429837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-947a1864-9ed1-4cc5-8427-022546e93a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:07:45.431884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 743/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:07:45 2022] DELETE /identity/v3/projects/ba9a9ddfc7474e21bb59764afc3f1da6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:07:54.867380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=62 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:07:55.423648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:15.964975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:15.965615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:15.965615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:15.966986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:15.971681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985d95d-dad1-454f-a40d-9d2b2c1e4e4f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:15.972110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985d95d-dad1-454f-a40d-9d2b2c1e4e4f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:15.972209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985d95d-dad1-454f-a40d-9d2b2c1e4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:16.052108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e985d95d-dad1-454f-a40d-9d2b2c1e4e4f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:16.053268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e985d95d-dad1-454f-a40d-9d2b2c1e4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:16.155082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:16.308933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:16.311003 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:16.427487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a5a79-1996-4472-9d0a-9647bb91b80d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:16.433514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:16.434117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:16.434398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:16.434671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:16.442543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:16.444123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744875d-eca1-4be4-ae86-0d5585566c00 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:16.453964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 769/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:17.530947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e85e6-e055-4d4b-9b73-eb2335b6af4d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:17.531443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e85e6-e055-4d4b-9b73-eb2335b6af4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:17.531540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e85e6-e055-4d4b-9b73-eb2335b6af4d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:17.532839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:17.538919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8700-d665-4f75-9f0b-ef0348b84ced None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:17.539352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8700-d665-4f75-9f0b-ef0348b84ced None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:17.539478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f8700-d665-4f75-9f0b-ef0348b84ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:17.559133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-891f8700-d665-4f75-9f0b-ef0348b84ced None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:17.560331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-891f8700-d665-4f75-9f0b-ef0348b84ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:17.568445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:17.722899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e85e6-e055-4d4b-9b73-eb2335b6af4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:17.737551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e85e6-e055-4d4b-9b73-eb2335b6af4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:17.742979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:17.743871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:17.744159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:17.744443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:17.754914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:17.756533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bb9cd-852a-483c-a2e1-cd70dd583a74 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:17.768622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 746/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:18.009006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07922c6-a597-485c-b9df-39d2758afe7a None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:18.009213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07922c6-a597-485c-b9df-39d2758afe7a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:18.009515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07922c6-a597-485c-b9df-39d2758afe7a None None] PATH_INFO: `/v3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:18.010830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 771/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Oct 5 14:09:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:09:18.017142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d9261-74cf-406c-b002-939e1e4f2a1f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:18.017468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d9261-74cf-406c-b002-939e1e4f2a1f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:18.017750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d9261-74cf-406c-b002-939e1e4f2a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:18.080065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-055d9261-74cf-406c-b002-939e1e4f2a1f None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:18.081302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-055d9261-74cf-406c-b002-939e1e4f2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:18.098386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:18.153342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 747/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Oct 5 14:09:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:21.674271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2541-f485-40fc-bdbc-12e009fcebc8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:21.674752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2541-f485-40fc-bdbc-12e009fcebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:21.674886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be2541-f485-40fc-bdbc-12e009fcebc8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:21.676380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 772/1519] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:21.682130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9208-036d-43c3-9987-1f850c3de259 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:21.682558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9208-036d-43c3-9987-1f850c3de259 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:21.682695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e9208-036d-43c3-9987-1f850c3de259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:21.702880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f86e9208-036d-43c3-9987-1f850c3de259 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:21.704101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f86e9208-036d-43c3-9987-1f850c3de259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:21.712689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 748/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:21.720235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2541-f485-40fc-bdbc-12e009fcebc8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:21.733764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be2541-f485-40fc-bdbc-12e009fcebc8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:21.738789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:21.739390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:21.739672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:21.739950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:21.749186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:21.750795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231b341-37ef-4cf5-8512-3ea301b4c25f service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:21.760873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 773/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:29.238084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00289-b8b8-4db8-8396-8eb0d4258bd9 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:29.238610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00289-b8b8-4db8-8396-8eb0d4258bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:29.238727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00289-b8b8-4db8-8396-8eb0d4258bd9 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:29.240004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:29.246479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981af16-0677-431d-a62e-bb51f34c2849 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:29.246910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981af16-0677-431d-a62e-bb51f34c2849 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:29.247025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981af16-0677-431d-a62e-bb51f34c2849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:29.265942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4981af16-0677-431d-a62e-bb51f34c2849 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:29.267121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4981af16-0677-431d-a62e-bb51f34c2849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:29.275363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:29.428393 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00289-b8b8-4db8-8396-8eb0d4258bd9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:29.442751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00289-b8b8-4db8-8396-8eb0d4258bd9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:29.448132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:29.448719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:29.449001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:29.449308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:29.457143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:29.458744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bfe79-db0e-4db6-86c3-bea4860d5c15 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:29.468426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 750/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:30.537469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835ff26-8301-4c9c-b436-9fa5385ba26e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:30.538078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835ff26-8301-4c9c-b436-9fa5385ba26e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:30.538078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835ff26-8301-4c9c-b436-9fa5385ba26e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:30.539418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 14:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:30.545626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2ca4-1041-41b2-9a13-7adc88404d85 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:30.546080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2ca4-1041-41b2-9a13-7adc88404d85 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:30.546199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c2ca4-1041-41b2-9a13-7adc88404d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:30.565527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c69c2ca4-1041-41b2-9a13-7adc88404d85 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:30.566724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c69c2ca4-1041-41b2-9a13-7adc88404d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:30.575327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 14:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:30.728986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835ff26-8301-4c9c-b436-9fa5385ba26e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:30.743823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835ff26-8301-4c9c-b436-9fa5385ba26e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:30.749315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:30.749974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:30.750316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:30.750678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:30.759330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:30.760897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62cf3-543e-41c8-8fd7-ec08648bb20b service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:30.770287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 776/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:34.669274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:34.669805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:34.669934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:34.671244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:34.676620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cf2e-c27e-4484-abd5-2433dbb0c1b4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:34.677062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cf2e-c27e-4484-abd5-2433dbb0c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:34.677160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cf2e-c27e-4484-abd5-2433dbb0c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:34.697253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2893cf2e-c27e-4484-abd5-2433dbb0c1b4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:34.698441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2893cf2e-c27e-4484-abd5-2433dbb0c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:34.706172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:34.990721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:34.993044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:35.069970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f513f2-fe5a-4f05-932a-0f36fa1d6d27 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:35.073513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:35.074108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:35.074392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:35.074662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:35.083263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:35.084673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056cade-cdef-4a0b-b3a9-f46e74438ab5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:35.093790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 753/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:37.225460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:37.225971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:37.225971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:37.227369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:37.232703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348636-8c1d-482c-94af-63283019e4f5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:37.233121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348636-8c1d-482c-94af-63283019e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:37.233259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348636-8c1d-482c-94af-63283019e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:37.252422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dd348636-8c1d-482c-94af-63283019e4f5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:37.253637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd348636-8c1d-482c-94af-63283019e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:37.262225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:37.550878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:37.552573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:37.565929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ac9c1-30e6-4b4c-b825-4c3b492c4de8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:37.569379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:37.569966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:37.570848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:37.571123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:37.579871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:37.581303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb55a2-4cb7-47de-8366-9ad393bfa6a8 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:37.590446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 779/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:41.403384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:41.403944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:41.403944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:41.405166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:41.410492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28848bb-b6b6-45d9-8fd9-f08acb59c3d0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:41.410906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28848bb-b6b6-45d9-8fd9-f08acb59c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:41.411037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28848bb-b6b6-45d9-8fd9-f08acb59c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:41.430581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c28848bb-b6b6-45d9-8fd9-f08acb59c3d0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:41.431760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c28848bb-b6b6-45d9-8fd9-f08acb59c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:41.439837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:41.747105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:41.748740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:41.813450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:41.827071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453491c-af22-4dbb-9d84-b74668ca7faa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:41.830631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:41.831258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:41.831533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:41.831803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:41.841053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:41.842486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e02d-e970-4638-9fb0-176803fce737 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:41.851691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 756/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:44.003946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:44.004499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:44.004499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:44.005896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 14:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:09:44.011697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a685-b681-48d9-9fdb-b2ce2fcc0e4c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:44.012141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a685-b681-48d9-9fdb-b2ce2fcc0e4c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:44.012237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40a685-b681-48d9-9fdb-b2ce2fcc0e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:44.032387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8b40a685-b681-48d9-9fdb-b2ce2fcc0e4c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:09:44.033627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8b40a685-b681-48d9-9fdb-b2ce2fcc0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:44.042298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:09:44.342847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:09:44.344545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:09:44.357248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39196390-9170-46e8-8c85-0bd6cd23d8b8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:09:44.360653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:09:44.361268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:09:44.361542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:09:44.361816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:09:44.371160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:09:44.372574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776a02-9732-42e4-b7c4-151b2c4e95a0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:09:44.381662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 782/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:09:54.027489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=11 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:09:54.377555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:09.882490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:09.883541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:09.884045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:09.907837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:09.909912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:09.927769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 758/1540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:09.936538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:09.937086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:09.937086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:09.970237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:09.971454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:09.985447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 783/1541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:09.990102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.006504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4d97-0dcb-4099-9bdd-95c6a43d04cd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.017498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.018398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.018931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.019426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.020290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:10.020822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.026284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.039303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 759/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:10.050170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.064777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cdadd-ea69-4d19-9445-9092463ea0f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.071637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.072250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.072532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.072806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.073473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.075394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8137ff-79d5-44ca-bd10-570c67b16d60 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.152465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 784/1543] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:10.157474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.174440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa530d-d9cb-4edc-9946-592f7876def2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.223816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07da1-c551-4dfa-b973-1b7dcf4eb11d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.224184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07da1-c551-4dfa-b973-1b7dcf4eb11d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.224503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07da1-c551-4dfa-b973-1b7dcf4eb11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.261216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.262247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.262754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.263252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.264148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.266414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.271860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-23a07da1-c551-4dfa-b973-1b7dcf4eb11d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.271860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-23a07da1-c551-4dfa-b973-1b7dcf4eb11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.288339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 785/1544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:10.299127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.299566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.299846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.307100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 760/1545] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:10.311195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.324719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831498b-7017-4e57-95fd-44e6e9d228b2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.332720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.333437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.333964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.334560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.335126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.335620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.336485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.338962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.354343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 786/1546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:10.355481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 761/1547] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:10.359196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.359600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.375114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341c4a-a32c-428d-a160-7db8d300a12e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.376404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e18e7-d73e-414d-b47f-023d4a67503a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.382581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.383538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.383774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.384354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.384480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.384733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.385008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.385428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.385687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:10.386043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.386744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.387072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:10.387072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:11:10.387072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:11:10.388248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.389366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.405398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 762/1548] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:10.408975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 787/1549] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:10.410099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.417707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.421428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793930-c3fd-4200-b9dc-0217cadfd13f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.433589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.434621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.435132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.435628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] PATH_INFO: `/v3/projects/65df2d34063643b0a2b156c4e709c098/users/0ef0b4ec21cc432aa3b9fbd5218b4fec/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.440179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ff9fa-09d9-4a1d-8ee0-81e1232fac3d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.453185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.454036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.454244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.454480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.455125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.457205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.458081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65df2d34063643b0a2b156c4e709c098, user_id=0ef0b4ec21cc432aa3b9fbd5218b4fec, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.459341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:10.459341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:11:10.459341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:11:10.466125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f87511-f7e1-4457-b009-bba00cf08c32 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.488441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 763/1550] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:10 2022] PUT /identity/v3/projects/65df2d34063643b0a2b156c4e709c098/users/0ef0b4ec21cc432aa3b9fbd5218b4fec/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:10.503214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e367-928a-4e99-9e58-0d011716811b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.503884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e367-928a-4e99-9e58-0d011716811b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.504480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e367-928a-4e99-9e58-0d011716811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.524277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 788/1551] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:10.529068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.553622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4ca6e367-928a-4e99-9e58-0d011716811b None None] MFA Rules not processed for user `0ef0b4ec21cc432aa3b9fbd5218b4fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.554874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4ca6e367-928a-4e99-9e58-0d011716811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.636941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e3727-cdeb-467e-b711-ebdb21c18603 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.642345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.642974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.643257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.643534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.644288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.645425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:10.645425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:11:10.645425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:11:10.646644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f751c1-19ad-478e-abe2-713b44e34d8c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.653313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 764/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:10.653313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4023c-5b37-4b24-b595-5636f7a7d2d4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.653313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4023c-5b37-4b24-b595-5636f7a7d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.653313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4023c-5b37-4b24-b595-5636f7a7d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.673811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 789/1553] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:10.674263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-84d4023c-5b37-4b24-b595-5636f7a7d2d4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.674877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7522c-f9cf-4e1f-ad6f-29f0fd9375fe None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.675302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7522c-f9cf-4e1f-ad6f-29f0fd9375fe None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.675587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7522c-f9cf-4e1f-ad6f-29f0fd9375fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.678387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-84d4023c-5b37-4b24-b595-5636f7a7d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.687730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 765/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.688843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326345f-847a-4557-8c66-32df56e05edc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.689133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326345f-847a-4557-8c66-32df56e05edc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.689435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326345f-847a-4557-8c66-32df56e05edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.695161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-baf7522c-f9cf-4e1f-ad6f-29f0fd9375fe None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.696354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-baf7522c-f9cf-4e1f-ad6f-29f0fd9375fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.704719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 790/1555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.705182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:10.705923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.706207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.706480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.718981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2326345f-847a-4557-8c66-32df56e05edc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.720199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2326345f-847a-4557-8c66-32df56e05edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.733853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 766/1556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.734897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.735186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.735463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.736051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.740976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.754420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 791/1557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.754420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.761601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.762806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.763786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632175e-5810-4330-9056-4e66c3883fd0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.768426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.769035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.769343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.769614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.770372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.772520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc92dd-271c-4876-90fe-f0e77be9e6a3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.779961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 767/1558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.779961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.800094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902f82-7cde-485e-9e9a-148ecb52379f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.805944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.807426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.807710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.808039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.808741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.810522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae025a-17e1-4cb8-bfe8-64c6b327b09b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.815850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 792/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:10.817064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8bd9-c29b-43aa-a35f-0823182d0ebf None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.817440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8bd9-c29b-43aa-a35f-0823182d0ebf None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.817715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8bd9-c29b-43aa-a35f-0823182d0ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.822770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 768/1560] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:10.826684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f77c2-3191-40f5-841b-79b1cd3c89a0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.826975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f77c2-3191-40f5-841b-79b1cd3c89a0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.827253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f77c2-3191-40f5-841b-79b1cd3c89a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.836888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5bbb8bd9-c29b-43aa-a35f-0823182d0ebf None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.838158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5bbb8bd9-c29b-43aa-a35f-0823182d0ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.845734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-271f77c2-3191-40f5-841b-79b1cd3c89a0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.846889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-271f77c2-3191-40f5-841b-79b1cd3c89a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.861875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:10.897672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 793/1561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.901645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074ae0-6baa-42ce-b8c7-9bd2d122e309 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.901645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074ae0-6baa-42ce-b8c7-9bd2d122e309 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.901645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074ae0-6baa-42ce-b8c7-9bd2d122e309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.908866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 769/1562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.910243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82441-71dc-432f-9b6a-7b57a4bc88d5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.910588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82441-71dc-432f-9b6a-7b57a4bc88d5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.910922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82441-71dc-432f-9b6a-7b57a4bc88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.918638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-74074ae0-6baa-42ce-b8c7-9bd2d122e309 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.919822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-74074ae0-6baa-42ce-b8c7-9bd2d122e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.927616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 794/1563] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.928712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.928990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.929282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.932694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dae82441-71dc-432f-9b6a-7b57a4bc88d5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.933918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dae82441-71dc-432f-9b6a-7b57a4bc88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.941718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 770/1564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.942950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.943234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.943504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.950179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.951343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.959354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 795/1565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.959966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.962392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:10.963877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:10.969031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e750e-a7c8-402d-a51b-51f2e083c2f6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.971876 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 771/1566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:10.972648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:10.975045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.975755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.976148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.976429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.977061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.979619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:10.982477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09702e-28ad-4b97-8d4e-497593982142 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:10.987092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:10.987680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:10.987963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:10.988239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:10.988879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:10.990509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.004860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 772/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.005060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 796/1568] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:10 2022] POST /identity/v3/users => generated 309 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.005179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.005518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.012810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611d87d-820b-4e81-ad4f-809668d8b356 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.014831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529a9e-ba6d-4c04-ad29-626b71b0b916 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.017457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.018045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.018379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.018656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.019294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.019533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.019658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.020122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.020400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.020671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.021186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.021342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.021667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.023264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.033267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 797/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.034044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.035942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 773/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.036802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.046351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f5ff-4637-4b59-8f0f-19fa6be83923 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.047527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0c44f-b0e1-41cb-a11a-c364c4699f04 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.051361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.051952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.052069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.052227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.052544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.052655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.052877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.053148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.053265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.053489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.053818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.054116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.055070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.055665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f120a61-03ad-4149-8699-208ba0c81cc9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.074541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 798/1571] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.074724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 774/1572] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.074835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.074955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.074955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.074955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.084838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068f5cc-6fce-4055-9650-e13c0b0d6901 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.090229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.090671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:11.090829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.091106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.091372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.091852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:11.092004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.092309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.093994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.099928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 775/1573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:11.100704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.114310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 799/1574] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.114310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.114569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29e56-28c4-443a-8dce-97f47d748dcc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.119043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.119639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.119923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.120196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.120866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.122565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.124043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae67dcf-de43-4b91-afbf-84299038c25b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.128627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.129431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.129708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.130028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] PATH_INFO: `/v3/projects/b44ac94c10c24033ac90cae24c9af051/users/88c5474b1caa4618a81f5855a49ff515/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.136072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 776/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.136072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.144005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924de2c9-312b-47e5-b410-a96e9b9905b3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.144598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44ac94c10c24033ac90cae24c9af051, user_id=88c5474b1caa4618a81f5855a49ff515, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.147308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.148630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.149348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.149521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.150338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.151020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.152025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:11.152025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:11:11.152025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:11:11.153211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.160569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 800/1576] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:11 2022] PUT /identity/v3/projects/b44ac94c10c24033ac90cae24c9af051/users/88c5474b1caa4618a81f5855a49ff515/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:11.161258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.182833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 777/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.183573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.228925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85b0b-3f09-459c-a505-da2188c3fe18 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.233932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:11.245305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1458c9-32d1-45eb-b9c4-c7cb2aedce9d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.249886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.250492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.250777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.251054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.251691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.253648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.269053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:11.283947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 778/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.283947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.287949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.288557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.288838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.289111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.289785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.292240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.319418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 801/1579] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.320226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.346427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823baa8-d0ec-444e-afd5-61e373f4c8a6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.383268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27375-b774-4ad7-ad02-ae9734078945 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.388057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.388661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.388941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.389216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.389880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:11.390192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.391795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.402373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.402986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.403268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.403546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.403989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 802/1580] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:11.404176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.404881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.406120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.414268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f27f3-9a56-415f-9aaf-a292d53eac16 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.419864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.420446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.420723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.420994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.421656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.423531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0f85d-e290-426e-ba33-a864284c0d6f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.434398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 779/1581] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.435215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.456737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 803/1582] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.456737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.456737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.456737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.475945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:11.477314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:11.496938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb63bd0-a0b7-45e8-8a4c-c7b61659589c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.508780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:11.536851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 804/1583] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:11.537767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.546798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e57c-681e-4fdc-ad00-e9fed806cca0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.551686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.552186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.552470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.552743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.553402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.555330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.558276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.558928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.559205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.559478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] PATH_INFO: `/v3/projects/44560db3fdc54f319d0e60963c2940e3/users/f2129f2317f84ec39aa734286bb0c32d/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.575051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44560db3fdc54f319d0e60963c2940e3, user_id=f2129f2317f84ec39aa734286bb0c32d, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.577756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.577902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 805/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.578682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.589378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a61ea-0d03-44b1-86bb-aeac787fb7eb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.591851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 780/1585] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:11 2022] PUT /identity/v3/projects/44560db3fdc54f319d0e60963c2940e3/users/f2129f2317f84ec39aa734286bb0c32d/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:11.592637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.608075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:11.646726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.647350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.647621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.647895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.648519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.651080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.654165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b69da-6b3c-43c4-a0e5-57a5d31a5ee9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.658642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.659396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.659999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.659999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.660549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.662486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.674744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 806/1586] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.674744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.684830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db585c-0fea-4249-b408-bc4e88b06efa admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.687040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 781/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.687906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.691615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.692235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.692520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.692796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.693445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.695363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.697964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b64bf-4e4d-4870-81df-3b4c8553a499 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.702916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.703492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.703767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.704040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.704682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.706595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.725804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 807/1588] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.726620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.732145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 782/1589] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.733204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.796641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26a26-84f1-49c8-a75a-74e83fcbd993 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.796832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c150-685e-4e47-b6ae-d5a18efbe6de admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.801202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.801834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.802115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.802387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.803015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.804932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.823609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:11.829053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 808/1590] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.832893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.842305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce17d0-4da6-4386-80a0-603667c28a3e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.846939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.847532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.847813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.848102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.848729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.849356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.849969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.850253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.850428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.850539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.859735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.860216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 809/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.861177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.863892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.872051 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 783/1592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:11.873401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.874294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d477b3d-4cd9-4554-87f9-c0ea59149983 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.879233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.879834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.880147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.880399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.881018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.882666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.886871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976787fb-5eed-4efd-923f-0c0ffb9865c4 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.894170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 810/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.894940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.897634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.898287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.898727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.898882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.899611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.901407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.906956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be248-cd46-4480-8c79-b4fee51b85eb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.912586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.913154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.913579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.913876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.914525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.915718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 784/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.916286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.918263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.927939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 811/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.928761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.930129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc5ff-875b-4db2-8f1f-c00ee0f8f7f6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.936021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.937130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.937770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.938366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.939279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c3f02-ead3-46b4-aec2-d6989159b47c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.939783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.943270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.944229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.944835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.945110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.945429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.946075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.948283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.961577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 812/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:11.964580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.975006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 785/1597] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:11 2022] POST /identity/v3/users => generated 284 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:11.976098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:11.980446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0f34-f00f-4357-b3fd-bf48b4f63977 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.985800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.986109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.986318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be7122-a2c1-4367-986f-91300581d1c0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:11.986434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.986648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.987296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.989483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:11.991390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:11.992028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:11.992365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:11.992638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:11.994224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:11.996114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.002342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 813/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.003253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.011947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 786/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.015110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8eede-821f-4f14-a045-613a09b1e6ae admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.016020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.020342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.021026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.021322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.021602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] PATH_INFO: `/v3/projects/44560db3fdc54f319d0e60963c2940e3/users/f2129f2317f84ec39aa734286bb0c32d/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.023505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44560db3fdc54f319d0e60963c2940e3, user_id=f2129f2317f84ec39aa734286bb0c32d, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.026268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.027159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e76b2-6266-4ec4-a36e-e03942b77070 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.032345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.032693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.032978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.033323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.033941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.035597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.046763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 814/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/44560db3fdc54f319d0e60963c2940e3/users/f2129f2317f84ec39aa734286bb0c32d/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.046763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.057195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 787/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.057195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.067687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.067807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069135f-9a6e-4ca2-8016-ed7fa955c6d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.130993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f477ba-fb1d-4169-8c7e-9aca70d86975 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.133460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.134670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.134987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.135266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.136102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.137432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.137792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.138170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.138456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.138728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.139373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.141015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.152524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 788/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.152524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.152945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 815/1603] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.153684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.162358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6716d7-6cae-4553-8124-3256c9453db6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.166347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224405a8-d9f2-4af9-990a-ebf139c53afd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.167540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.168163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.168444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.168718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.169399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.171054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.171600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.172768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.172768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.173001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.173482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.175127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55ba79-aa76-4f61-9a2f-ed763b39b64f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.190630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 789/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.190630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.200479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7c00-888a-4c4f-b069-718c55f6c28c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.201783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 816/1605] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.202924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.203220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.203697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.208753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.209590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.209975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.210370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] PATH_INFO: `/v3/projects/791692a741cd49af91cce92a0672b57a/users/e805d10dcc2e4dc7baf6792c7ca53510/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.236130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791692a741cd49af91cce92a0672b57a, user_id=e805d10dcc2e4dc7baf6792c7ca53510, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.239169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.242760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] MFA Rules not processed for user `f2129f2317f84ec39aa734286bb0c32d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.245331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:12.258419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 790/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/791692a741cd49af91cce92a0672b57a/users/e805d10dcc2e4dc7baf6792c7ca53510/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.258419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.317183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.338639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 817/1607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:12.339118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3741-fe52-4279-9b20-8a4dee2c83f7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.339698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.345302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.346280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.346699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.346981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] PATH_INFO: `/v3/projects/089a805e7e6346dd8481b683a4060c44/users/3011b7cd55e64fcab9ceb114658e1f8f/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.351428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ec73e-e8d7-42f2-a408-9a093d718592 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.357256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.357930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.358228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.358861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] PATH_INFO: `/v3/projects/80b3167e7ad94627b239bf680217ff61/users/3603342a11f14f3d9edd7dbcbf08d72d/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.366233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089a805e7e6346dd8481b683a4060c44, user_id=3011b7cd55e64fcab9ceb114658e1f8f, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.369977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.378210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b3167e7ad94627b239bf680217ff61, user_id=3603342a11f14f3d9edd7dbcbf08d72d, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.381332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.387640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 791/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/089a805e7e6346dd8481b683a4060c44/users/3011b7cd55e64fcab9ceb114658e1f8f/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.388726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.403660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 818/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/80b3167e7ad94627b239bf680217ff61/users/3603342a11f14f3d9edd7dbcbf08d72d/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.404895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.458589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ba924-d0b9-49ce-8523-1c18b4bace13 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.467902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.472963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202103-fa1c-455b-a741-6cc1de1f1a9e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.480340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.481499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.481790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.482072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.483308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.485289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.497977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 819/1610] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:12.498795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.514683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ada0d-782e-4fc9-ad12-fb52530e8e89 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.522539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.523219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.523504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.523786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] PATH_INFO: `/v3/projects/b5c5253c54844ef49259a6f3d3034852/users/905e9f2e4b88438d9c7ffbf18694850a/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.526971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.528569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.528717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.528988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] PATH_INFO: `/v3/projects/94c1bb6694b0490e8dd54d2a9d14d544/users/5c9787225e9646fd881aaa4f87d33dec/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.539967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c5253c54844ef49259a6f3d3034852, user_id=905e9f2e4b88438d9c7ffbf18694850a, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.546494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7ecae-47f0-4906-a582-629a7be24e4c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.547580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c1bb6694b0490e8dd54d2a9d14d544, user_id=5c9787225e9646fd881aaa4f87d33dec, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.550356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.563518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 820/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/b5c5253c54844ef49259a6f3d3034852/users/905e9f2e4b88438d9c7ffbf18694850a/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.566823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 792/1612] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/94c1bb6694b0490e8dd54d2a9d14d544/users/5c9787225e9646fd881aaa4f87d33dec/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.566964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0afa-904c-4aa7-99da-ce1b92758014 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.567230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0afa-904c-4aa7-99da-ce1b92758014 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.567776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0afa-904c-4aa7-99da-ce1b92758014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.568339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.592388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cc5d0afa-904c-4aa7-99da-ce1b92758014 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.593869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cc5d0afa-904c-4aa7-99da-ce1b92758014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:12.632141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced0a5-6bd4-47c1-b7f9-8cc8893be0c8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.641267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.641267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.641267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.641267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.657251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:12.680180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 821/1613] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:12.682225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49863e3-6939-4335-a085-6eeb17c34356 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.682796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49863e3-6939-4335-a085-6eeb17c34356 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.683567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49863e3-6939-4335-a085-6eeb17c34356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.725633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a49863e3-6939-4335-a085-6eeb17c34356 None None] MFA Rules not processed for user `3011b7cd55e64fcab9ceb114658e1f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.727497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a49863e3-6939-4335-a085-6eeb17c34356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:12.749243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.750717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b4a6-509f-4ff9-a308-52ce51f63ddf service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.760827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 793/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:12.762540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.762828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.763198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.794731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.796434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:12.829053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 794/1615] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:12.829588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:12.842171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 822/1616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:12.843751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d6fb-f126-4666-9c74-89e61b2f4fa5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:12.843875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.844400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.844868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.851207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:12.852303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.852423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.853930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] PATH_INFO: `/v3/projects/a9a1e1ff32444e3ca3cf86c1bf876f84/users/5d055a540e1e43bbb06873c2730635fb/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.885270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1e1ff32444e3ca3cf86c1bf876f84, user_id=5d055a540e1e43bbb06873c2730635fb, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:12.885666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6da5-9c56-43ed-8730-d9d40445caef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:12.910050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 795/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:12 2022] PUT /identity/v3/projects/a9a1e1ff32444e3ca3cf86c1bf876f84/users/5d055a540e1e43bbb06873c2730635fb/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:12.911535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:12.911688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:12.911857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:12.942695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] MFA Rules not processed for user `905e9f2e4b88438d9c7ffbf18694850a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.943924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:12.961650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] MFA Rules not processed for user `5c9787225e9646fd881aaa4f87d33dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:12.964466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.054876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:13.098427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 823/1618] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:13.103453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.115917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 796/1619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:13.115917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.199490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e9a42-eb91-4a2d-854e-f1f07cee9a64 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:13.202379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7837f3-45d6-48b2-a20c-0d47ddc2f436 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:13.204236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:13.205101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.205696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.206055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.207485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:13.208165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.208458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.208732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.241730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:13.303128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:13.304794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7f85-d72f-47ee-a0fc-74735e930d08 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:13.312125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:13.314154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:13.320244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 824/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:13.321759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a386-a5f2-4384-807a-44fd39fb2c75 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.322009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a386-a5f2-4384-807a-44fd39fb2c75 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.322288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61a386-a5f2-4384-807a-44fd39fb2c75 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.323899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 825/1621] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:13.324931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.325764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.325764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.335101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 797/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:13.336053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.348580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d426d6-22bc-47fd-bfdb-2ac72826e613 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:13.354407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:13.355133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.355522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.355909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] PATH_INFO: `/v3/users/0ef0b4ec21cc432aa3b9fbd5218b4fec` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.357671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef0b4ec21cc432aa3b9fbd5218b4fec)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:13.358927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: WARNING py.warnings [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:13.358927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: warnings.warn(msg) Oct 05 14:11:13.358927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: Oct 05 14:11:13.360672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:13.375968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] MFA Rules not processed for user `5d055a540e1e43bbb06873c2730635fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:13.377853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.480212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef0b4ec21cc432aa3b9fbd5218b4fec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:13.500643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 826/1623] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:13.500643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.527572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88c272-741a-4c69-9818-7fb760bcd679 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:13.528807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef0b4ec21cc432aa3b9fbd5218b4fec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:13.542769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:13.543465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.543700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.543963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.544792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:13.546347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef0b4ec21cc432aa3b9fbd5218b4fec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:13.547484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef0b4ec21cc432aa3b9fbd5218b4fec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:13.548975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef0b4ec21cc432aa3b9fbd5218b4fec'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:13.559208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7b5f-519b-4682-8f53-3f2c7c67a571 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:13.574721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 798/1624] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:13 2022] DELETE /identity/v3/users/0ef0b4ec21cc432aa3b9fbd5218b4fec => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:13.576006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.578867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.610616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 827/1625] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:13 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:13.611987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.612272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.612544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.641057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:13.671800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626a446-db5d-47d7-b7f5-705d2444eb51 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:13.682189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:13.684213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.718338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:13.800512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:13.800512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.800512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.800512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.801933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:13.801933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44418-dde3-4623-ba6d-daa2c5c73f7e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:13.840557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 828/1626] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:13.841579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:13.843074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.873320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 799/1627] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:13 2022] POST /identity/v3/projects => generated 365 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:13.875511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:13.876085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:13.876502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:13.927523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:13.929022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:13.932977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd465d-7719-48b2-a5fb-a67e6e39ce09 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.046165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.046897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.047249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.047597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.049602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:14.054208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 800/1628] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:14.056592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.058922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:14.073864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357f012-882a-49cb-88b3-e9f14d66de00 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.080602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.081676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.082040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.082487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.083690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.085896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.127017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 801/1629] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:14 2022] POST /identity/v3/users => generated 296 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:14.128828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.139992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:14.157675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.164853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.196317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 829/1630] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:14.198783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.229873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e59b-6ca1-4e08-8629-c0084f236ec1 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.235947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.236824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.237249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.237628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.238434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.240556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.271713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 830/1631] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:14 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:14.273794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.276227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:14.304084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d09c8b-0fa4-465d-ad5f-3ccdf8cb9d57 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.318819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.319452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.319736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.321066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.330569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:14.351843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ee2-4797-42f3-a070-f12e9e1808aa admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.357254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.358113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.358495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.358855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.376940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.378650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.393737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 831/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:14.394891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.406706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ed2d7-427b-4042-9a1d-381be57d270d service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.412735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.413588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.414087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.414461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.415466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.417915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.431790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:14.433079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 832/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:14.434341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.452543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfd869-0df9-49f4-8a70-e8aa52c38606 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.463026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.464904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.467314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.468043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.469570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.471152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.471917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.476917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.502181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 802/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:14.503394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.517249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 833/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:14.520495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.529772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa46a-92c3-43f2-95ae-82fe138db7fa service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.539752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.541392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.542065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.542065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] PATH_INFO: `/v3/projects/1eee44bd1f094a3783fb08b171f36056/users/32db5fcbf5344ae28ad4ac58e2a2f0bf/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.544930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300accc-3783-4dce-96bf-fdb306ef068e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.558871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.559622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.560001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.576830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] PATH_INFO: `/v3/projects/20032042317e4cc58ab7305fa0852665/users/bb34919fc6fa458c91e1fc68801f7881/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.585575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eee44bd1f094a3783fb08b171f36056, user_id=32db5fcbf5344ae28ad4ac58e2a2f0bf, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.595517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.622257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20032042317e4cc58ab7305fa0852665, user_id=bb34919fc6fa458c91e1fc68801f7881, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.631984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.632453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 803/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:14 2022] PUT /identity/v3/projects/1eee44bd1f094a3783fb08b171f36056/users/32db5fcbf5344ae28ad4ac58e2a2f0bf/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:14.633840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.660595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 834/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:14 2022] PUT /identity/v3/projects/20032042317e4cc58ab7305fa0852665/users/bb34919fc6fa458c91e1fc68801f7881/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:14.664986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.812298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc86d8-9641-4781-861a-28bdeb2d1533 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.821650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.821889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.822714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.822714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.823327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.825815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.840009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0674b-8697-43dd-b6e4-1b960adcc228 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.851857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.855371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 835/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:14.857904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.858203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.859628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.859748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.862780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.878311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.880535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ae93-eb8e-42f5-81b9-6b7a2f3f7a92 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.908731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:14.909521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.909942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.910316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] PATH_INFO: `/v3/projects/20032042317e4cc58ab7305fa0852665/users/bb34919fc6fa458c91e1fc68801f7881/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.916219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 804/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:14.917298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:14.917989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20032042317e4cc58ab7305fa0852665, user_id=bb34919fc6fa458c91e1fc68801f7881, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:14.920785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afb13e-f68a-45cb-8bd3-a77cd004044b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:14.940294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 836/1640] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:14 2022] PUT /identity/v3/projects/20032042317e4cc58ab7305fa0852665/users/bb34919fc6fa458c91e1fc68801f7881/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:14.951038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0106d-76d6-4c12-b464-1fa746c730dd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:14.951489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0106d-76d6-4c12-b464-1fa746c730dd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:14.951954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0106d-76d6-4c12-b464-1fa746c730dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:14.962903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16f9c-c7ea-4609-bbf0-0df820c2d81b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:14.997888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bdb0106d-76d6-4c12-b464-1fa746c730dd None None] MFA Rules not processed for user `bb34919fc6fa458c91e1fc68801f7881`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:14.999272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bdb0106d-76d6-4c12-b464-1fa746c730dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.008733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:15.084848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:15.086071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.086504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.087546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] PATH_INFO: `/v3/projects/1eee44bd1f094a3783fb08b171f36056/users/32db5fcbf5344ae28ad4ac58e2a2f0bf/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.089752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eee44bd1f094a3783fb08b171f36056, user_id=32db5fcbf5344ae28ad4ac58e2a2f0bf, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:15.094398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15ef1-8706-4a4e-8fff-8f3d67e9a674 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:15.112253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 805/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:14 2022] PUT /identity/v3/projects/1eee44bd1f094a3783fb08b171f36056/users/32db5fcbf5344ae28ad4ac58e2a2f0bf/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:15.123022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.123628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.124343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.166974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] MFA Rules not processed for user `32db5fcbf5344ae28ad4ac58e2a2f0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:15.168381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.214273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 837/1642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:15.217993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.218408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.219201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.228995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:15.232627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 838/1643] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 14:11:15 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:15.237099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:15.249440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.327196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 806/1644] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:15.331056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:15.331056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.417660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807010e8-c73b-4bb0-8a18-614cfe3fa4de None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:15.422553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:15.423243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.423528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.423799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] PATH_INFO: `/v3/projects/65df2d34063643b0a2b156c4e709c098` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.425095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=65df2d34063643b0a2b156c4e709c098)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:15.426153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: WARNING py.warnings [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 14:11:15.426153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: warnings.warn(msg) Oct 05 14:11:15.426153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: Oct 05 14:11:15.427763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:15.470587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cddf9-46c4-40f8-9556-ac8af91cb242 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:15.476880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:15.478473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.478954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.479634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.543705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65df2d34063643b0a2b156c4e709c098', 'request_id': 'req-0e394733-171a-4880-a4cd-ce2f409622aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:15.553822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65df2d34063643b0a2b156c4e709c098', 'request_id': 'req-0e394733-171a-4880-a4cd-ce2f409622aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:15.588052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65df2d34063643b0a2b156c4e709c098', 'request_id': 'req-0e394733-171a-4880-a4cd-ce2f409622aa'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:15.616021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] The token cache is being invalidate because project 65df2d34063643b0a2b156c4e709c098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:15.616377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:15.618774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e394733-171a-4880-a4cd-ce2f409622aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:15.628726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 839/1645] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:15 2022] DELETE /identity/v3/projects/65df2d34063643b0a2b156c4e709c098 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:15.628726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.628726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.628726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.684888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:15.690169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:15.736066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:15.737653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.752116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 807/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:15.753010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:15.784863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f31a-4127-4ddf-abea-eb0a822b62a6 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:15.855734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:15.965308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 840/1647] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:15.967145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:15.970714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:15.971534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:15.971829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:15.972103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:15.973433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:15.976386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:16.062771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:16.119250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:16.120706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:16.139882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd881b2-39e7-4805-b86a-f93444b25135 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:16.142710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 808/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:16.153006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:16.154840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:16.155148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:16.155524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] PATH_INFO: `/v3/users/f2129f2317f84ec39aa734286bb0c32d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:16.158196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2129f2317f84ec39aa734286bb0c32d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:16.164081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:16.232625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:16.234203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:16.252815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad3537-2f2b-4543-b060-963fc7bb3c46 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:16.262036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:16.264153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:16.264541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:16.265206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:16.288092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2129f2317f84ec39aa734286bb0c32d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:16.296890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:16.298944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:16.318983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2129f2317f84ec39aa734286bb0c32d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:16.319838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2129f2317f84ec39aa734286bb0c32d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:16.332544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 809/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:11:16.344920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2129f2317f84ec39aa734286bb0c32d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:16.345496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-09df0ee5-c801-4274-8192-828b3f7c8d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2129f2317f84ec39aa734286bb0c32d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:16.390922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 841/1650] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:15 2022] DELETE /identity/v3/users/f2129f2317f84ec39aa734286bb0c32d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:16.685161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:16.688117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:16.719066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480efde-1b49-4942-bf55-67f3ed178695 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:16.890610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:16.890610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:16.890610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:16.890610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:16.897031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:16.981640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:16.984113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b58542-cbdf-466a-be20-7c2024e4d495 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:17.005569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 810/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:11:17.851433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe59-bbca-44f2-a5ca-676dc8ed19fa None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:17.851433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe59-bbca-44f2-a5ca-676dc8ed19fa None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:17.851433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe59-bbca-44f2-a5ca-676dc8ed19fa None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:17.852018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 842/1652] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:17.887101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:17.887614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:17.887810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:17.939247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:17.943553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:18.085615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e75e2-9520-4499-845f-c3218005f8c3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:18.086241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e75e2-9520-4499-845f-c3218005f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:18.086641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e75e2-9520-4499-845f-c3218005f8c3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:18.089185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 843/1653] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 14:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 14:11:18.095019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:18.095486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:18.095939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:18.099855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 811/1654] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:18.119723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:18.121378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:18.140369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 844/1655] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:18.148058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:18.150102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:18.168892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49063124-9edd-49a6-978a-d2e75d11d1af None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:18.175424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:18.176045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:18.176330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:18.176712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:18.202524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:18.210443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:18.213335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:18.230879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 812/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:18.579405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:18.580871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:18.614493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb74cc0-b19f-46a9-8fe7-f5aa539f2947 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:18.629347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:18.629996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:18.630281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:18.633024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:18.640426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:18.806211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:18.876995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:18.878835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12414ca5-917a-414b-9cfb-75d94b4b12af service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:18.896430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 845/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:19.599973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:19.601498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:19.949684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e715a-d9e5-4913-8be3-5e55838aa687 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:19.964982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:19.965851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:19.966133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:19.966408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] PATH_INFO: `/v3/projects/44560db3fdc54f319d0e60963c2940e3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:19.968448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44560db3fdc54f319d0e60963c2940e3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:19.970415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:20.190081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44560db3fdc54f319d0e60963c2940e3', 'request_id': 'req-0d605f86-45d6-481a-aefa-6ee4af292d3e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:20.215047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44560db3fdc54f319d0e60963c2940e3', 'request_id': 'req-0d605f86-45d6-481a-aefa-6ee4af292d3e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:20.233389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44560db3fdc54f319d0e60963c2940e3', 'request_id': 'req-0d605f86-45d6-481a-aefa-6ee4af292d3e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:20.315042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] The token cache is being invalidate because project 44560db3fdc54f319d0e60963c2940e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:20.318121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:20.320898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0d605f86-45d6-481a-aefa-6ee4af292d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:20.327451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 813/1658] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:19 2022] DELETE /identity/v3/projects/44560db3fdc54f319d0e60963c2940e3 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:20.331221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:20.331841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:20.332114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:20.402847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:20.406822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:20.651429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 846/1659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:20.660381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:20.660908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:20.660989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:20.720376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:20.722001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:20.754080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 814/1660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:20.756621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:20.779666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42599f1-6c0c-4202-93ed-f397af1853f7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:20.804223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:20.807497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:20.807828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:20.808108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:20.808850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:20.810659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:20.815706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:20.863872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 847/1661] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:20.866933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:20.899583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6f52c-7977-49e7-a8ce-4d4741f21e26 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:20.904991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:20.905755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:20.906273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:20.906633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:20.907588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:20.911745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:20.979369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 815/1662] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:20 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:20.983599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:21.004806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb40b6e-01a9-4c95-8817-357c26d97129 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:21.198881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:21.201888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:21.202283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:21.202666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:21.204544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:21.208459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:21.264272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 848/1663] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:20 2022] POST /identity/v3/users => generated 282 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:21.265750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:21.280378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ead4-4023-45ae-8f03-d126ba911ec8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:21.297940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:21.298478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:21.299010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:21.299305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:21.314032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:21.315963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:21.334352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 816/1664] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:21.335561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:21.348241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417332-cee2-4f13-b2ba-0ed4559120a2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:21.355841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:21.356971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:21.358565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:21.359029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:21.363216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:21.365125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4df9af-e018-45a1-ba3f-3ff2547ec3a2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:21.420464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 849/1665] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:21.421162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:21.437059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c208c-47c7-4cf6-8b66-aa88469b4e12 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:21.451011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:21.451701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:21.452016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:21.452247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] PATH_INFO: `/v3/projects/3ef8075ae05e40c38447477f7695536f/users/564809d28a664789bb3e53178399d3c8/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:21.494940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef8075ae05e40c38447477f7695536f, user_id=564809d28a664789bb3e53178399d3c8, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:21.502015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:21.534824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 817/1666] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:21 2022] PUT /identity/v3/projects/3ef8075ae05e40c38447477f7695536f/users/564809d28a664789bb3e53178399d3c8/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:21.552833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:21.553511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:21.556077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:21.674746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] MFA Rules not processed for user `564809d28a664789bb3e53178399d3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:21.676903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:21.725670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:21.905084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:21.911694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 850/1667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:21.982136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:22.104865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b10f-e475-45bb-a5e9-80ed5987a2f4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:22.145296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:22.146800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:22.150935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:22.152401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:22.153682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:22.159775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:22.234210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 818/1668] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:21 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:22.237953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:22.261917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a58d3-1079-4bbf-8036-b76ace58ea77 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:22.504171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:22.506647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:22.507172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:22.508468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:22.509178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:22.517848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:22.587872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 851/1669] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:22 2022] POST /identity/v3/users => generated 288 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:22.594339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:22.612962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d02-645d-476f-a79d-3f7b4d6892c4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:22.635123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:22.637998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:22.638347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:22.638634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:22.640515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:22.645059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb2af-f2fc-4393-9b4c-2b7ae6c76b9f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:22.678414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 819/1670] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:22.682124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:22.697193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf3cf-0db7-400a-8186-b981cd53018e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:22.712506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:22.713665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:22.714213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:22.714506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] PATH_INFO: `/v3/projects/0967abd6d35d4a49acd5029a7d6c9900/users/122769e8024540aead178081bae2a27b/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:22.751323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9632-6afe-485b-ba0a-58e08ddd3ed0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:22.751635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9632-6afe-485b-ba0a-58e08ddd3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:22.751979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9632-6afe-485b-ba0a-58e08ddd3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:22.774932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0967abd6d35d4a49acd5029a7d6c9900, user_id=122769e8024540aead178081bae2a27b, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:22.790678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:22.830265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 852/1671] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:22 2022] PUT /identity/v3/projects/0967abd6d35d4a49acd5029a7d6c9900/users/122769e8024540aead178081bae2a27b/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:22.833760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:22.844553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-68ab9632-6afe-485b-ba0a-58e08ddd3ed0 None None] MFA Rules not processed for user `88c5474b1caa4618a81f5855a49ff515`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:22.857488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-68ab9632-6afe-485b-ba0a-58e08ddd3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.048715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f539147-b13e-4b09-baac-6bc76e907236 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:23.060879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:23.062506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:23.062506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:23.062752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:23.063568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:23.079222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:23.096748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 820/1672] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:23.100879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:23.101401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:23.102273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:23.109630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 853/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:23.114498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:23.157786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9844-e085-4734-87fa-876dbd61638d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:23.172170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:23.172827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] MFA Rules not processed for user `88c5474b1caa4618a81f5855a49ff515`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:23.173812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:23.178140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.178655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:23.179074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] PATH_INFO: `/v3/projects/0967abd6d35d4a49acd5029a7d6c9900/users/122769e8024540aead178081bae2a27b/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:23.183956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0967abd6d35d4a49acd5029a7d6c9900, user_id=122769e8024540aead178081bae2a27b, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:23.194971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4036faf-f61a-4541-ac90-0fb1c0c652dd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:23.232385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 821/1674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:23.235975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:23.243000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.267407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 854/1675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:23 2022] PUT /identity/v3/projects/0967abd6d35d4a49acd5029a7d6c9900/users/122769e8024540aead178081bae2a27b/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:23.277851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:23.278964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:23.284964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:23.298094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87f89-6103-4f5d-bcb2-22ece7432749 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:23.430218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] MFA Rules not processed for user `122769e8024540aead178081bae2a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:23.432027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.460161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:23.491584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:23.493771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:23.496975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:23.497444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] PATH_INFO: `/v3/users/905e9f2e4b88438d9c7ffbf18694850a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:23.499805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=905e9f2e4b88438d9c7ffbf18694850a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:23.503889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:23.591783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:23.694792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905e9f2e4b88438d9c7ffbf18694850a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:23.752951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905e9f2e4b88438d9c7ffbf18694850a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:23.764660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 855/1676] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:23.765848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:23.770581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.793547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905e9f2e4b88438d9c7ffbf18694850a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:23.794316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905e9f2e4b88438d9c7ffbf18694850a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:23.795107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905e9f2e4b88438d9c7ffbf18694850a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:23.839507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 822/1677] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:23 2022] DELETE /identity/v3/users/905e9f2e4b88438d9c7ffbf18694850a => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:23.840192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:23.849652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:23.961044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7f3e3-6c28-4969-b39d-9c05de7898f1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.041136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d240f-2445-41c0-8a5f-00f946d3ff5c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.047485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.048146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.048420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.048695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] PATH_INFO: `/v3/users/3011b7cd55e64fcab9ceb114658e1f8f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.049998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3011b7cd55e64fcab9ceb114658e1f8f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:24.052362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:24.087415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.088071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.088362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.088640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.093882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.170233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:24.186045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3011b7cd55e64fcab9ceb114658e1f8f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:24.206984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:24.209026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa0fec-43df-44a5-8612-5427d3fc5b5f service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:24.213891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3011b7cd55e64fcab9ceb114658e1f8f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:24.221612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 856/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:24.223708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7763-07e3-4120-abef-d25149e99078 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.224004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7763-07e3-4120-abef-d25149e99078 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.224466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7763-07e3-4120-abef-d25149e99078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.232992 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3011b7cd55e64fcab9ceb114658e1f8f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:24.233855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3011b7cd55e64fcab9ceb114658e1f8f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:24.234724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3011b7cd55e64fcab9ceb114658e1f8f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:24.260738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 823/1679] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:23 2022] DELETE /identity/v3/users/3011b7cd55e64fcab9ceb114658e1f8f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:24.265447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:24.267950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b04c7763-07e3-4120-abef-d25149e99078 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:24.268258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.271848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b04c7763-07e3-4120-abef-d25149e99078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.338613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:24.418438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891be18-4083-483b-9198-24ce7715eda7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.427714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.428549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 857/1680] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:24.429754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.430226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.438109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe58e-2c71-459d-8ee3-23884923a3be None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.438750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.439804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe58e-2c71-459d-8ee3-23884923a3be None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.440878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe58e-2c71-459d-8ee3-23884923a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.444665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.493784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f9bbe58e-2c71-459d-8ee3-23884923a3be None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:24.495031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f9bbe58e-2c71-459d-8ee3-23884923a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.513729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 858/1681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:24.514935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.515227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.517531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.594907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] MFA Rules not processed for user `e805d10dcc2e4dc7baf6792c7ca53510`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:24.608408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:24.609102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.610255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:24.627135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 824/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:24.631154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:24.635819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.789554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7bb9-68a1-489c-b53e-de8dbade2d8f service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.801502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.802390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.802936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.803358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.822058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 859/1683] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:24.830172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:24.832063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:24.832734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:24.835329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.857608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 825/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:24.863552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08417-fc4a-47dd-8500-b8b307dd243b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.875738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.876618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.877093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.877523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:24.900383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:24.902468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:24.926021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 860/1685] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:24.963811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:24.965861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.971707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:24.973360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:24.984030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb848f6e-63c0-416d-b534-449625502544 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:24.989132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:24.990038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:24.990428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:24.990814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:25.004266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:25.066405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:25.140185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e049-3517-4163-985a-a3ea9c6c98b9 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:25.156204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:25.156886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:25.157170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:25.157482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:25.174681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:25.176387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9a26c-4cad-48bc-ad32-d7a58b7472d6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:25.176515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:25.182906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ad24-cc3e-4d5d-ac56-92f601d0fcd7 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:25.205425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 826/1686] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:25.226049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 861/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:25.645674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7073-332e-4cef-bd4e-ea25f30c7db1 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:25.646023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7073-332e-4cef-bd4e-ea25f30c7db1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:25.646322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7073-332e-4cef-bd4e-ea25f30c7db1 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:25.648500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 827/1688] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 14:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:25.655188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:25.655751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:25.656038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:25.817485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:25.822000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:25.843991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 862/1689] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:25.852997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7073-332e-4cef-bd4e-ea25f30c7db1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:25.879265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7073-332e-4cef-bd4e-ea25f30c7db1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:25.889208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:25.890003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:25.890284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:25.890555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:25.905620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:25.911213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:25.921488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:25.935645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 828/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:26.909214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:26.910750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:26.943795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:26.949873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:26.979563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b094e1c-1cfe-420e-b2ec-a577d243d218 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:27.013205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:27.014569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.015024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.015557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] PATH_INFO: `/v3/projects/089a805e7e6346dd8481b683a4060c44` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.019295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=089a805e7e6346dd8481b683a4060c44)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:27.021830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:27.163294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd788d06-084a-49ef-ba73-3e7d230ae581 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:27.203740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089a805e7e6346dd8481b683a4060c44', 'request_id': 'req-b6c92554-a233-4ebd-914e-94c913c9a64d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:27.231692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089a805e7e6346dd8481b683a4060c44', 'request_id': 'req-b6c92554-a233-4ebd-914e-94c913c9a64d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:27.246710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089a805e7e6346dd8481b683a4060c44', 'request_id': 'req-b6c92554-a233-4ebd-914e-94c913c9a64d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:27.268769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] The token cache is being invalidate because project 089a805e7e6346dd8481b683a4060c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:27.269052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:27.273299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6c92554-a233-4ebd-914e-94c913c9a64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:27.284998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 829/1691] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:26 2022] DELETE /identity/v3/projects/089a805e7e6346dd8481b683a4060c44 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:27.286539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affd51-5109-4879-85cc-4618f9a5f2c6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.286840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affd51-5109-4879-85cc-4618f9a5f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.296174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affd51-5109-4879-85cc-4618f9a5f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.359981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-21affd51-5109-4879-85cc-4618f9a5f2c6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:27.366791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-21affd51-5109-4879-85cc-4618f9a5f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:27.378413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:27.382347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.382740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.382945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.391704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:27.437063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:27.439086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:27.474986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 863/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:27.478793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:27.482463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:27.538273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 830/1693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:27.570068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.570436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.570723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.621519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:27.623367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:27.650481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 831/1694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:27.652465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:27.658544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:27.667531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd1325-78ee-4630-b479-066577f1c2cf None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:27.678743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:27.679494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.679844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.680184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.682965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:27.683540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:27.685265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:27.721448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 832/1695] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:27.725790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:27.737398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cba3d-c67e-41a4-b28c-752cb21c0a77 service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:27.762037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:27.763208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.767300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5e95-068f-4f68-b620-8ff07cf57d15 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:27.773130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.773695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] PATH_INFO: `/v3/users/5c9787225e9646fd881aaa4f87d33dec` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.782968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9787225e9646fd881aaa4f87d33dec)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:27.784965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:27.787007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:27.788634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:27.788634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:27.788634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:27.791219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:27.793730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:27.884971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 833/1696] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:27.886367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:27.893400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:27.981910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9787225e9646fd881aaa4f87d33dec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.035148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:28.050135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9787225e9646fd881aaa4f87d33dec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.051496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9787225e9646fd881aaa4f87d33dec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.068663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9787225e9646fd881aaa4f87d33dec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.069926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9787225e9646fd881aaa4f87d33dec'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.113934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7f0cc-503c-4cc3-a2eb-9d6196d2df48 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:28.115340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 864/1697] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:27 2022] DELETE /identity/v3/users/5c9787225e9646fd881aaa4f87d33dec => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:28.116326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:28.118702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:28.321403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70f416-7228-44b7-8a65-d5cae03af51a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:28.334084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:28.335187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:28.336177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:28.337744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:28.338912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:28.340098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:28.340337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:28.340680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:28.341256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] PATH_INFO: `/v3/projects/b5c5253c54844ef49259a6f3d3034852` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:28.342959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c5253c54844ef49259a6f3d3034852)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:28.357328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314f98a-aa1f-4646-b6d7-491c50d92b9a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:28.358865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:28.412607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 865/1698] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:28 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:28.417668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:28.421545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:28.423372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:28.450536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:28.451937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:28.474959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c5253c54844ef49259a6f3d3034852', 'request_id': 'req-ebbc6b0d-9bbe-4532-8207-5c65781bf328'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.497326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c5253c54844ef49259a6f3d3034852', 'request_id': 'req-ebbc6b0d-9bbe-4532-8207-5c65781bf328'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.507924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c5253c54844ef49259a6f3d3034852', 'request_id': 'req-ebbc6b0d-9bbe-4532-8207-5c65781bf328'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.569195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] The token cache is being invalidate because project b5c5253c54844ef49259a6f3d3034852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:28.573488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.574460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.582440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 834/1699] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:27 2022] DELETE /identity/v3/projects/b5c5253c54844ef49259a6f3d3034852 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:28.583444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:28.585170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:28.626872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:28.682288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 866/1700] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:28.683343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:28.686931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:28.721582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b5e6-c567-4484-bd5a-7611b4134695 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:28.736889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:28.737616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:28.737945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:28.738177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] PATH_INFO: `/v3/users/32db5fcbf5344ae28ad4ac58e2a2f0bf` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:28.744837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32db5fcbf5344ae28ad4ac58e2a2f0bf)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:28.748223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:28.844745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc6b0d-9bbe-4532-8207-5c65781bf328 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:28.855681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:28.859641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:28.859641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:28.859641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:28.860557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:28.865892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:28.911138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 835/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:28.916481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:28.922768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:28.946402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32db5fcbf5344ae28ad4ac58e2a2f0bf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.962652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:28.990540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32db5fcbf5344ae28ad4ac58e2a2f0bf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:28.993760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32db5fcbf5344ae28ad4ac58e2a2f0bf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.017389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32db5fcbf5344ae28ad4ac58e2a2f0bf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.018506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32db5fcbf5344ae28ad4ac58e2a2f0bf'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.050189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 867/1702] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:28 2022] DELETE /identity/v3/users/32db5fcbf5344ae28ad4ac58e2a2f0bf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:29.054291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:29.057372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.100824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775ce2e-2346-46f0-be59-a7e207b83754 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:29.212526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e6ad-34d4-4843-9220-e6348bb4d53e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:29.223169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:29.225507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.226886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.227431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.228476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:29.232499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e16270-7268-4f9a-8c89-b9c9b66f1979 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:29.234906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:29.235541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.235826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.236105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.238432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.268075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:29.269629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:29.271545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 868/1703] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:29.274952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3c5d-10a1-484c-800f-b37fe5027b10 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.290412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3c5d-10a1-484c-800f-b37fe5027b10 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.291265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f3c5d-10a1-484c-800f-b37fe5027b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.315275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 836/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:29.317696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:29.351430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d29f3c5d-10a1-484c-800f-b37fe5027b10 None None] MFA Rules not processed for user `3603342a11f14f3d9edd7dbcbf08d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:29.352863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704810db-9cb1-437a-b580-0eb01ce30d3e service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:29.354265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d29f3c5d-10a1-484c-800f-b37fe5027b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.387375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:29.389093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.389377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.389672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] PATH_INFO: `/v3/projects/e80e29d641dd44ad992a698ca781c760/users/935f62151a824a58b2b41c0d7f8b9ac9/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.439307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80e29d641dd44ad992a698ca781c760, user_id=935f62151a824a58b2b41c0d7f8b9ac9, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:29.444944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:29.473817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:29.481126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 837/1705] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:29 2022] PUT /identity/v3/projects/e80e29d641dd44ad992a698ca781c760/users/935f62151a824a58b2b41c0d7f8b9ac9/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:29.489608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:29.503034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.520979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 869/1706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:29.522596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca079-65e4-4b44-a908-e3ac09ba1d9d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.522894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca079-65e4-4b44-a908-e3ac09ba1d9d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.523205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca079-65e4-4b44-a908-e3ac09ba1d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.622707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8f9ca079-65e4-4b44-a908-e3ac09ba1d9d None None] MFA Rules not processed for user `935f62151a824a58b2b41c0d7f8b9ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:29.624656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f9ca079-65e4-4b44-a908-e3ac09ba1d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.679172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c918cc-c5fd-470e-8107-aebc4ee301ae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:29.695924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:29.696600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.696890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.700247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] PATH_INFO: `/v3/users/564809d28a664789bb3e53178399d3c8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.707688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564809d28a664789bb3e53178399d3c8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:29.717205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:29.800427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 870/1707] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:29.801948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:29.802248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:29.802535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:29.826694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] MFA Rules not processed for user `3603342a11f14f3d9edd7dbcbf08d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:29.828782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:29.864575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:29.871028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564809d28a664789bb3e53178399d3c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.899612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564809d28a664789bb3e53178399d3c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.927134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564809d28a664789bb3e53178399d3c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.927784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564809d28a664789bb3e53178399d3c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.928441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564809d28a664789bb3e53178399d3c8'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:29.949345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 838/1708] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:29 2022] DELETE /identity/v3/users/564809d28a664789bb3e53178399d3c8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:29.952357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:29.954506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.004004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 871/1709] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:30.004004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:30.004910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.047911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3b34e-5bcf-40d3-ae2a-2b2f948c87ba None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:30.104022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890b231-e416-482d-830e-9c2c71a1d7d6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:30.133514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:30.134157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:30.134817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:30.134919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:30.136744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.168209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:30.170134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:30.170382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:30.171322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] PATH_INFO: `/v3/projects/1eee44bd1f094a3783fb08b171f36056` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:30.174578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eee44bd1f094a3783fb08b171f36056)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:30.176628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:30.246251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:30.265163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:30.279151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:30.283249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eee44bd1f094a3783fb08b171f36056', 'request_id': 'req-29b74e93-52d3-46b8-a0bf-3e4ab318980d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.296580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eee44bd1f094a3783fb08b171f36056', 'request_id': 'req-29b74e93-52d3-46b8-a0bf-3e4ab318980d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.304760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eee44bd1f094a3783fb08b171f36056', 'request_id': 'req-29b74e93-52d3-46b8-a0bf-3e4ab318980d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.310492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 839/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:30.313672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:30.315587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.321548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] The token cache is being invalidate because project 1eee44bd1f094a3783fb08b171f36056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:30.321888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.322821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-29b74e93-52d3-46b8-a0bf-3e4ab318980d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.324576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 872/1711] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:30 2022] DELETE /identity/v3/projects/1eee44bd1f094a3783fb08b171f36056 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:30.326059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:30.326634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:30.335153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:30.349600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1454171-caed-44b6-8431-b86bb8266c49 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:30.397037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:30.398582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.491313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:30.493006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:30.493500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:30.493988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] PATH_INFO: `/v3/users/5d055a540e1e43bbb06873c2730635fb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:30.495928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d055a540e1e43bbb06873c2730635fb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:30.498924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:30.500994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:30.576529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 873/1712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:30.577722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:30.579471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.643467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d055a540e1e43bbb06873c2730635fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.677381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d055a540e1e43bbb06873c2730635fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.707183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d055a540e1e43bbb06873c2730635fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.707545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d055a540e1e43bbb06873c2730635fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.709061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-73a7d435-27c9-4e84-8b06-a9c38fb1dc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d055a540e1e43bbb06873c2730635fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:30.771057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 840/1713] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:30 2022] DELETE /identity/v3/users/5d055a540e1e43bbb06873c2730635fb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:30.773759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:30.775509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:30.775809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:30.789203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55f0ed-7b9b-4b3b-848f-d55e6fc7d1e8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:30.831314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:30.832781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:30.957032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:31.022548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.023359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.023512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.029335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.035078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.075310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 841/1714] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:31.076259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.082028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.193206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.195023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.210165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 874/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:31.211076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.212424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.225347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba541c-e141-4e07-87b2-23710e6bb6f2 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:31.231083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.231658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.231937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.232213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] PATH_INFO: `/v3/projects/94c1bb6694b0490e8dd54d2a9d14d544` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.233358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c1bb6694b0490e8dd54d2a9d14d544)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.235271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.249306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cb8ff-c974-4fd2-8d4e-d27666adb5c4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:31.253575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.254269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.254657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.255024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.257017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.269993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.271747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6b98-676c-4cce-8b72-810d8026c227 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.283929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 842/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:31.285773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da276-6ef5-47e5-b2b8-ad23e73e0076 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.285773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da276-6ef5-47e5-b2b8-ad23e73e0076 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.286126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7da276-6ef5-47e5-b2b8-ad23e73e0076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.309440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9d7da276-6ef5-47e5-b2b8-ad23e73e0076 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:31.311300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9d7da276-6ef5-47e5-b2b8-ad23e73e0076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.325697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 843/1717] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:31.327898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618428d1-0f44-455d-a708-820bf16177ff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.328265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618428d1-0f44-455d-a708-820bf16177ff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.328791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618428d1-0f44-455d-a708-820bf16177ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.368304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c1bb6694b0490e8dd54d2a9d14d544', 'request_id': 'req-cc9a90a3-7d3b-4a6a-862d-56c03b513547'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.374796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-618428d1-0f44-455d-a708-820bf16177ff None None] MFA Rules not processed for user `e805d10dcc2e4dc7baf6792c7ca53510`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:31.376481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-618428d1-0f44-455d-a708-820bf16177ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.378755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c1bb6694b0490e8dd54d2a9d14d544', 'request_id': 'req-cc9a90a3-7d3b-4a6a-862d-56c03b513547'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.386531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c1bb6694b0490e8dd54d2a9d14d544', 'request_id': 'req-cc9a90a3-7d3b-4a6a-862d-56c03b513547'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.402972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] The token cache is being invalidate because project 94c1bb6694b0490e8dd54d2a9d14d544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:31.403282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.404090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cc9a90a3-7d3b-4a6a-862d-56c03b513547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.405262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:31.409521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 875/1718] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:31 2022] DELETE /identity/v3/projects/94c1bb6694b0490e8dd54d2a9d14d544 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:31.411517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.411517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.411517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.449374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:31.450718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.500487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 844/1719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:31.503636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618428d1-0f44-455d-a708-820bf16177ff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.506929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-618428d1-0f44-455d-a708-820bf16177ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.553868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 876/1720] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:31.554964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.556932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.579221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:31.631738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5425e-972c-40e5-a992-0c6e3b7509fd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:31.636943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.638045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.638624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.638929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.641723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.667758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.669335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499aad8-3510-4f01-be20-99765336b359 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.679100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618428d1-0f44-455d-a708-820bf16177ff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:31.682831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 877/1721] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:31.684226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.684519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.684800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.692983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.693664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.693944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.694216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] PATH_INFO: `/v3/users/935f62151a824a58b2b41c0d7f8b9ac9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.695378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=935f62151a824a58b2b41c0d7f8b9ac9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.697937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.747497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:31.749694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.815717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935f62151a824a58b2b41c0d7f8b9ac9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.841800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935f62151a824a58b2b41c0d7f8b9ac9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.849032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 878/1722] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:31.850157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.851736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.878107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783de98-9df3-4540-b050-884ecf8b3d6f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:31.879812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935f62151a824a58b2b41c0d7f8b9ac9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.880540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935f62151a824a58b2b41c0d7f8b9ac9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.882695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935f62151a824a58b2b41c0d7f8b9ac9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.890057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:31.890740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:31.891022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:31.891298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] PATH_INFO: `/v3/users/bb34919fc6fa458c91e1fc68801f7881` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:31.896401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb34919fc6fa458c91e1fc68801f7881)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:31.901949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:31.908843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 845/1723] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:31 2022] DELETE /identity/v3/users/935f62151a824a58b2b41c0d7f8b9ac9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:31.910049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:31.913592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:31.992167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb34919fc6fa458c91e1fc68801f7881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:31.998122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:32.020878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb34919fc6fa458c91e1fc68801f7881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:32.023052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb34919fc6fa458c91e1fc68801f7881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:32.035477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb34919fc6fa458c91e1fc68801f7881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:32.038062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ba4470c6-f1f7-4b3a-96e7-163c6df687ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb34919fc6fa458c91e1fc68801f7881'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:32.044118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b7e62-bbc0-44c4-aa9f-1542ea3f1f6a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.051041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.051666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.051945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.052477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.053142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:32.053537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.056730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.062477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 879/1724] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:31 2022] DELETE /identity/v3/users/bb34919fc6fa458c91e1fc68801f7881 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:32.064807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.065949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.066441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.075179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:32.083272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 846/1725] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:32.084223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.089741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.096111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:32.098013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.111615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753856f-93b0-4511-b448-11fee80096e8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.196300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.196970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.198955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.200212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.201042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.204681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.209360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 880/1726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:32.210372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.213624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.259679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 847/1727] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:32 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:32.263648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.368467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dfb3e-6a09-4523-8b1d-429801765477 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.397522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517c13e-1c84-4911-9a45-0158309e4d18 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.407517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.408141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.408423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.408698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.412238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.418346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.468920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 848/1728] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:32 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:32.468920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.474987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.494763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.495467 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.496019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.496371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.504928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.553055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:32.597609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:32.611008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afca5-919c-407c-8493-943a3ff46da4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.640262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.640896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.641330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.641883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.646681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.650528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dc7c1-b7ab-41fc-86f6-1cea48038719 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.662381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.664426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.678307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 849/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:32.679338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.692937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eab6fc-3a37-48d7-8c91-a71e73c536f8 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.697296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 881/1730] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:11:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:11:32.700420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575b2-8500-470b-941a-e0147c8f9111 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.702871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575b2-8500-470b-941a-e0147c8f9111 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.704379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280575b2-8500-470b-941a-e0147c8f9111 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.705950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 882/1731] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 14:11:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:32.709636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.711005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.712031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.713749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.714782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.717105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.718055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.719798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.720188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.750074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 850/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:32.753409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.783208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844ea26-b70e-46ca-bf58-00bcb9f3f1e1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.818231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.818865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.819146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.819419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.823499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.828291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:32.853253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:32.855821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.874649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 883/1733] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:11:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:32.882483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 851/1734] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:32.887459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.898385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:32.901530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:32.904624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704575-18f2-40b2-8311-611e004d5a83 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.919674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.920502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.920862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.921328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] PATH_INFO: `/v3/projects/894c6d1903394f7aaf5aa694965e7f8b/users/06dc56e54a75471aaff8e42b6815ca37/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.946708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb873fe-3ed7-430a-ad21-ac79c726594b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:32.956795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894c6d1903394f7aaf5aa694965e7f8b, user_id=06dc56e54a75471aaff8e42b6815ca37, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:32.960973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:32.964313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:32.964313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:32.966450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:32.967909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e0b3-0c21-4b5f-a8d8-0ff61dbefb69 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:33.006354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 884/1735] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:32 2022] PUT /identity/v3/projects/894c6d1903394f7aaf5aa694965e7f8b/users/06dc56e54a75471aaff8e42b6815ca37/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:33.008534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:33.008905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:33.009269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:33.012164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:33.015242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:33.063661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 852/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:11:33.090222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] MFA Rules not processed for user `06dc56e54a75471aaff8e42b6815ca37`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:33.091628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:33.301164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 885/1737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:33.306242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:33.335431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fedd9-8312-4cd9-9575-8ea91a09d39f service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:33.545854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:33.546484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:33.546766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:33.547045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:33.547773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:33.560534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:33.687139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 853/1738] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:33 2022] POST /identity/v3/projects => generated 379 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:33.691761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:33.726757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b760c-cfb3-4bba-81fd-a9b485e16c5a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:33.756426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:33.758722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:33.909278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:33.909868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:33.913312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:33.913685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:33.914380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:33.919963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:33.932941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270f11-a60b-4bcb-b182-a95bc9ace312 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:33.947022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:33.947691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:33.947974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:33.948249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] PATH_INFO: `/v3/projects/3ef8075ae05e40c38447477f7695536f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:33.953073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef8075ae05e40c38447477f7695536f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:33.958369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:33.974245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 886/1739] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:33 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:33.975554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:33.977683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:33.995347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c66b-eb53-4573-a812-2876687b9324 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:34.002184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:34.002967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.003252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.003580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] PATH_INFO: `/v3/projects/a9a1e1ff32444e3ca3cf86c1bf876f84` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:34.006108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1e1ff32444e3ca3cf86c1bf876f84)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:34.010732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:34.033193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:34.047647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:34.084040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef8075ae05e40c38447477f7695536f', 'request_id': 'req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.118443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef8075ae05e40c38447477f7695536f', 'request_id': 'req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.135008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef8075ae05e40c38447477f7695536f', 'request_id': 'req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.184423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1e1ff32444e3ca3cf86c1bf876f84', 'request_id': 'req-e4d06e71-bc5a-44e9-978d-346ff5b6474d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.190435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] The token cache is being invalidate because project 3ef8075ae05e40c38447477f7695536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:34.192324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.195152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.202981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1e1ff32444e3ca3cf86c1bf876f84', 'request_id': 'req-e4d06e71-bc5a-44e9-978d-346ff5b6474d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.207799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 854/1740] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:33 2022] DELETE /identity/v3/projects/3ef8075ae05e40c38447477f7695536f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:34.214272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1e1ff32444e3ca3cf86c1bf876f84', 'request_id': 'req-e4d06e71-bc5a-44e9-978d-346ff5b6474d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.214424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:34.218942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:34.320954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] The token cache is being invalidate because project a9a1e1ff32444e3ca3cf86c1bf876f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:34.321804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.322530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.324431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 887/1741] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:33 2022] DELETE /identity/v3/projects/a9a1e1ff32444e3ca3cf86c1bf876f84 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:34.329597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:34.332251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:34.428804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e71-bc5a-44e9-978d-346ff5b6474d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:34.474786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:34.475647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.476248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.476848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] PATH_INFO: `/v3/projects/e80e29d641dd44ad992a698ca781c760` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:34.479025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80e29d641dd44ad992a698ca781c760)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:34.480996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:34.500533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4efc6-8a63-4a64-af0c-0fbb8e860f16 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:34.518640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:34.519289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.519540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.520403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:34.521145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:34.526121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:34.572106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 855/1742] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:34.573256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:34.587848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:34.606565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4030-f75b-44cd-af7f-337e2bc51166 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:34.613958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:34.614881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.615174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.616632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] PATH_INFO: `/v3/users/122769e8024540aead178081bae2a27b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:34.621016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122769e8024540aead178081bae2a27b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:34.641637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:34.646214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80e29d641dd44ad992a698ca781c760', 'request_id': 'req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.672093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80e29d641dd44ad992a698ca781c760', 'request_id': 'req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.721598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80e29d641dd44ad992a698ca781c760', 'request_id': 'req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.784081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] The token cache is being invalidate because project e80e29d641dd44ad992a698ca781c760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:34.784709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.793739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-74e3eaa7-58e4-42d1-aa3a-849fc3fbfcdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.799755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 888/1743] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:34 2022] DELETE /identity/v3/projects/e80e29d641dd44ad992a698ca781c760 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:34.805352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.806508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.808655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:34.859169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122769e8024540aead178081bae2a27b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.895140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122769e8024540aead178081bae2a27b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.906279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:34.907318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:34.918719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122769e8024540aead178081bae2a27b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.919339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122769e8024540aead178081bae2a27b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.920298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-be154cd0-dfbc-412c-801b-d38d59bf0ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122769e8024540aead178081bae2a27b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:34.971518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:34.979670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 856/1744] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:34 2022] DELETE /identity/v3/users/122769e8024540aead178081bae2a27b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:34.989631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:34.990177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:34.990468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.083062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:35.084306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.096554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 889/1745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:35.096554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:35.096554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.156873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d578c-1496-467a-ae4f-ca58d73d6d04 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:35.203674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:35.236146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 857/1746] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Oct 5 14:11:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:35.237208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:35.238926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.428231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:35.428802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.429050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.429354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.430071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:35.434196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95586c-836f-4523-a97d-4a6f81128981 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:35.468727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 890/1747] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:35.470264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590433-af3d-4053-8bf8-0ac35ab621e8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.470559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590433-af3d-4053-8bf8-0ac35ab621e8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.481651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590433-af3d-4053-8bf8-0ac35ab621e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.494521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d2353-3100-4327-bb27-afdb188cb547 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:35.513623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:35.514892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.514892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.515068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] PATH_INFO: `/v3/projects/20032042317e4cc58ab7305fa0852665` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.520216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20032042317e4cc58ab7305fa0852665)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:35.528859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:35.541178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-56590433-af3d-4053-8bf8-0ac35ab621e8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:35.545743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-56590433-af3d-4053-8bf8-0ac35ab621e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.575553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 891/1748] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:35.577062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.577435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.577630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.625148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:35.626789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.643358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 892/1749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:35.645005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:35.648306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.684695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaf6c1-aaa4-425c-b122-cdcb9bbfd340 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:35.701637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20032042317e4cc58ab7305fa0852665', 'request_id': 'req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:35.722971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20032042317e4cc58ab7305fa0852665', 'request_id': 'req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:35.732771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20032042317e4cc58ab7305fa0852665', 'request_id': 'req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:35.747594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] The token cache is being invalidate because project 20032042317e4cc58ab7305fa0852665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:35.748577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:35.750215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:35.755982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 858/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:35 2022] DELETE /identity/v3/projects/20032042317e4cc58ab7305fa0852665 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:35.757342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:35.759139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.833105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:35.833759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.834039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.834308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.838548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:35.868952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:35.870473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff491f9b-7f92-4382-b5fe-a4d07b097403 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:35.906117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 893/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:35.908455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39ab1-0699-4ce6-9d45-0e5046855840 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:35.908893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39ab1-0699-4ce6-9d45-0e5046855840 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:35.909181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a39ab1-0699-4ce6-9d45-0e5046855840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:35.959982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c8a39ab1-0699-4ce6-9d45-0e5046855840 None None] MFA Rules not processed for user `3603342a11f14f3d9edd7dbcbf08d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:35.961877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c8a39ab1-0699-4ce6-9d45-0e5046855840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.057951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689a41-dfe7-4e3a-bafa-ff4f8dcc4019 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:36.082086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:36.090233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:36.091264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.091763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.092239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] PATH_INFO: `/v3/projects/7f571c67fa31465baf46b1d28743acbe/users/e49c369aaaae4c1db9cc67dc4da68fc9/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.106892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 894/1752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:36.108370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.108798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.109080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.168021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f571c67fa31465baf46b1d28743acbe, user_id=e49c369aaaae4c1db9cc67dc4da68fc9, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:36.170638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:36.171865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.173882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddea44b-a1f3-4b8d-9477-f3c971cf9a40 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:36.200861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 895/1753] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:36.200861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:36.201267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.211143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 859/1754] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:35 2022] PUT /identity/v3/projects/7f571c67fa31465baf46b1d28743acbe/users/e49c369aaaae4c1db9cc67dc4da68fc9/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:36.219527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390c89-2fae-456a-b737-890746349469 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.219976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390c89-2fae-456a-b737-890746349469 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.220270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390c89-2fae-456a-b737-890746349469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.229574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4784-3d2e-4f38-bedf-47f4bc1cde11 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:36.244925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:36.283011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5b390c89-2fae-456a-b737-890746349469 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:36.284265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5b390c89-2fae-456a-b737-890746349469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.362610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:36.363332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.363688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.364182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.365122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:36.368751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:36.370430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:36.406728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 896/1755] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:36.407984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:36.413926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.454354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb564b9-74f1-421d-87a0-ec130c97141e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:36.464806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:36.465509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.465762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.466095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] PATH_INFO: `/v3/projects/0967abd6d35d4a49acd5029a7d6c9900` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.469620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0967abd6d35d4a49acd5029a7d6c9900)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:36.471586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:36.607286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 860/1756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:36.612097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390c89-2fae-456a-b737-890746349469 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:36.623009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0967abd6d35d4a49acd5029a7d6c9900', 'request_id': 'req-aba84b38-86e7-4d22-be01-a3ff6862d88c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:36.647755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0967abd6d35d4a49acd5029a7d6c9900', 'request_id': 'req-aba84b38-86e7-4d22-be01-a3ff6862d88c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:36.663237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390c89-2fae-456a-b737-890746349469 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:36.694102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0967abd6d35d4a49acd5029a7d6c9900', 'request_id': 'req-aba84b38-86e7-4d22-be01-a3ff6862d88c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:36.734833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] The token cache is being invalidate because project 0967abd6d35d4a49acd5029a7d6c9900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:36.735084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:36.735831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-aba84b38-86e7-4d22-be01-a3ff6862d88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:36.738420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 897/1757] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:36 2022] DELETE /identity/v3/projects/0967abd6d35d4a49acd5029a7d6c9900 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:36.739830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7a96-0f56-4d17-b98d-e654e895f0b3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.740117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7a96-0f56-4d17-b98d-e654e895f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.740390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7a96-0f56-4d17-b98d-e654e895f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.817660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-671d7a96-0f56-4d17-b98d-e654e895f0b3 None None] MFA Rules not processed for user `e49c369aaaae4c1db9cc67dc4da68fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:36.819297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-671d7a96-0f56-4d17-b98d-e654e895f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.872762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:36.873428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.873714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.873997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.879289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:36.880527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:36.882058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:36.933392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 861/1758] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:36.944416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:36.946544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:36.948315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.961421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 898/1759] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:36.963754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292db3-5732-440f-af55-abe3fafa1a14 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.964714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292db3-5732-440f-af55-abe3fafa1a14 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.965896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292db3-5732-440f-af55-abe3fafa1a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.979201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01725a4-f10e-49b6-b373-e25dbd982168 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:36.996768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-79292db3-5732-440f-af55-abe3fafa1a14 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:36.997087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:36.997754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:36.998006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-79292db3-5732-440f-af55-abe3fafa1a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:36.998117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:36.998298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:36.998938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.000910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.023566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 899/1760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:37.025468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.025770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.031313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.069548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:37.072803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:37.081210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 862/1761] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:36 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.082103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.088709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:37.096258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 900/1762] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:37.098185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.099782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:37.147666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0b48-d6ab-4dd3-b7f1-344046c08fe7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.253416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5442df7-6acd-46d8-8ab1-85d0ab3224a0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.264263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.264917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.265184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.265486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.266109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.268716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.325199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.326068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.326292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.326573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.327230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.333285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:37.337406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.346140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 863/1763] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.347060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.477960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 901/1764] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/projects => generated 379 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.478901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.581020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5d07-cf2f-4ee2-859b-e33f2d2b6953 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.674096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b868c3-698a-4463-b2e5-1a51e481b7e8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.702126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.702774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.703062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.703428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.704082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.706946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c73ee-744a-4671-bbcb-0b79bb2d3656 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.771503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.772142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.772427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.772706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.773421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:37.773790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.775418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.796502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 902/1765] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.796502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.796502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.796502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.830869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 864/1766] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:37.831735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.836706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:37.838607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:37.849577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4038076-dd49-46f7-80eb-fde4285ef4fa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.852318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 903/1767] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:37.853866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.866038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bbaed-7f53-4e91-87cd-7d0ac6a06060 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.871708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.872444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.872831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.873210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.873974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.876057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.889902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.890651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.891461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.891858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.892701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.895921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.935603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 865/1768] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.935603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.951077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 904/1769] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:37.957934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:37.962096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2177f3-42a5-4427-a74b-f7adbefaa8cf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.975725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.976753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.977723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915704d2-e753-4ffa-890c-934e6e12d8d0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:37.978346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.979652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.980402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.985098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:37.985828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:37.986810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:37.987697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:37.988524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:37.989652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:37.995811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.022453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 866/1770] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.023208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.059288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 905/1771] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:37 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:38.060337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab487-caf8-45b3-a207-0265d05f1dca admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.064334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.147664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:38.233141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.233815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.234098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.234367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.235017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:38.235423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.238168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.266754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 867/1772] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:38.268834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.276294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f96db-57e3-4b7a-9403-b7c30372c60f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.293915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b4bff-996a-4a12-9f61-098cfdbd8bda admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.298322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.299051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.299350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.299625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.300369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.302071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.306568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.307380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.307824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.308225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.309009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.314583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.316981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:38.350287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 906/1773] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.351066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.351805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 868/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.352888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.375556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cecc3-630f-427e-a23f-7114f95e977f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.388064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b78b9-366f-4278-bd92-d05c6b552b0f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.395665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.396287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.396654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.396937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.397657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.399587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.407982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.427013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.430578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.431123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.433128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.446829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.461398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 869/1775] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:38 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:38.462330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.486772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781916b7-585d-4ef3-a550-d711e7e5b882 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.496129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 907/1776] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.500890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.501393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.501704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.502153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.502379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.503143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.505062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.525153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d228-8e04-41f2-9ce8-b5fdad1e6629 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.533663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.536103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.536808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.537332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] PATH_INFO: `/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6/users/1269bf6303a7457fbe3dad485c298c53/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.564133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 870/1777] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:38 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:38.565166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.604540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c263775f57d4c67b3cf2a2079b65ad6, user_id=1269bf6303a7457fbe3dad485c298c53, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.607756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.677897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 908/1778] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:38 2022] PUT /identity/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6/users/1269bf6303a7457fbe3dad485c298c53/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:38.679950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.751969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe7da4-36dc-4d92-b248-5fde47115169 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.896332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e20523-f295-4f02-89b0-9a9c91d3cfcd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.912920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.914375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.915392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.916168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.917027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.919071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.934690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 909/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.936150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.949609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.950280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.950552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.950791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.951431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.953030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:38.969480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 871/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:38.970403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:38.979552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a85a-5284-46b8-9b05-e1038c9ffd24 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.981159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18652d-9055-4efe-a48c-0f3a5eb821cf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:38.986954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:38.987580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:38.987860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:38.988728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:38.988833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:38.990728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.007020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.008954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.009384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.010174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] PATH_INFO: `/v3/projects/af5540ac1afc414bb1d737b6ed86e8f0/users/dae83b44b67b4811871d0077feba6375/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.022847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 872/1781] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:38 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:39.025092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.036555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e62f-20cc-4656-b75f-b9de92a1cf83 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.042798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.043598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.044017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.044578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.045402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.047464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d73ad-2006-4ffa-8473-f3325082fe7e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.063641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 873/1782] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:39.077740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5540ac1afc414bb1d737b6ed86e8f0, user_id=dae83b44b67b4811871d0077feba6375, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.083008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe926f2-fc1f-4df1-90dd-58b901572e4d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.084378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe926f2-fc1f-4df1-90dd-58b901572e4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.085819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe926f2-fc1f-4df1-90dd-58b901572e4d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.085952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.090412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 874/1783] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:11:39 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:39.094745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe926f2-fc1f-4df1-90dd-58b901572e4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.125907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe926f2-fc1f-4df1-90dd-58b901572e4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.153724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 910/1784] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:38 2022] PUT /identity/v3/projects/af5540ac1afc414bb1d737b6ed86e8f0/users/dae83b44b67b4811871d0077feba6375/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:39.154961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.252099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:39.283743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:39.319184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef21-37cc-4587-a888-2cd5295b63d4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.336110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.339223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.339532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.341184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] PATH_INFO: `/v3/projects/d84310baa39e4480b939f477fdaef629/users/c9846a907e354e649b0605ca4fb37ec2/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.346094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.346885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.348874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.349260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.350867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.354729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.387321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 875/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:39.387321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.390197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84310baa39e4480b939f477fdaef629, user_id=c9846a907e354e649b0605ca4fb37ec2, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.401572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.405619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27a14d-ec3e-4e79-bfb9-e40906b030be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.421056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.422082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.422542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.423006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.424581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.425986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57ff68-6126-4ad2-a47c-396a84ecfdfa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.438233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 911/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:39 2022] PUT /identity/v3/projects/d84310baa39e4480b939f477fdaef629/users/c9846a907e354e649b0605ca4fb37ec2/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:39.439339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.455342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 876/1787] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:39.457739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.458371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.465969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.498073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:39.499636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:39.592400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd6f3-0aaf-47e6-bfd1-f3caf3e517df admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.611715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.612569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.612958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.613400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] PATH_INFO: `/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6/users/1269bf6303a7457fbe3dad485c298c53/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.616894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c263775f57d4c67b3cf2a2079b65ad6, user_id=1269bf6303a7457fbe3dad485c298c53, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.620576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb023817-1c92-49d6-a1a3-1f2488008ece admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.677286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 912/1788] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:39 2022] PUT /identity/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6/users/1269bf6303a7457fbe3dad485c298c53/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:39.677286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e165-d457-4913-9b32-463a1b0deedb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.677286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e165-d457-4913-9b32-463a1b0deedb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.677286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e165-d457-4913-9b32-463a1b0deedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.702694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 877/1789] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:39.704890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:39.751927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c19e9d-84b7-46fb-88fa-f5094724ed20 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:39.774637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-62b6e165-d457-4913-9b32-463a1b0deedb None None] MFA Rules not processed for user `dae83b44b67b4811871d0077feba6375`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:39.776308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-62b6e165-d457-4913-9b32-463a1b0deedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:39.918310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:39.918733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.919822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.920539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] PATH_INFO: `/v3/projects/3ca3b267842c46bdb7e1fcdfc455311e/users/3b8f91ad87bc4be1b91fa9fce5c6c94e/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.944566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 913/1790] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:39.947175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac78e-377f-4987-aaa3-21e7abb29d26 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:39.947682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac78e-377f-4987-aaa3-21e7abb29d26 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:39.948612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac78e-377f-4987-aaa3-21e7abb29d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:39.957590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca3b267842c46bdb7e1fcdfc455311e, user_id=3b8f91ad87bc4be1b91fa9fce5c6c94e, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:39.961031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:39.986449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bc1ac78e-377f-4987-aaa3-21e7abb29d26 None None] MFA Rules not processed for user `c9846a907e354e649b0605ca4fb37ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:39.988337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bc1ac78e-377f-4987-aaa3-21e7abb29d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:39.994996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 878/1791] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:39 2022] PUT /identity/v3/projects/3ca3b267842c46bdb7e1fcdfc455311e/users/3b8f91ad87bc4be1b91fa9fce5c6c94e/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:39.995714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:40.076815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:40.101333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:40.139730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b441-cbf8-4339-8a80-1a9e023c038c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:40.155630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:40.156304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:40.156589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:40.156864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:40.157737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:40.159573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:40.163224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 914/1792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:40.165868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:40.166138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:40.167269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:40.180598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 879/1793] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:40.181431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:40.183099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:40.229499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] MFA Rules not processed for user `1269bf6303a7457fbe3dad485c298c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:40.230801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:40.525725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb265e-4b01-4d64-8cd5-06cc6d55ecf3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:40.537716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 915/1794] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:40.538623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:40.548120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:40.548925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:40.549131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:40.549485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:40.569706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:40.575986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e37be6-fecb-425f-9898-0edafbca967a service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:40.578297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55be09-b09d-45cd-b6f8-000ff9f3ea48 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:40.589931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 880/1795] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:40.591549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:40.591826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:40.592121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:40.620223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:40.620904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:40.621174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:40.621464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:40.629457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:40.636937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:40.659227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] MFA Rules not processed for user `3b8f91ad87bc4be1b91fa9fce5c6c94e`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:40.660989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:40.750316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 916/1796] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:40 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:40.751376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:40.934730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 881/1797] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:40.942568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:40.991013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c168c8-27b4-45dd-951b-dee089677e60 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.009411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486b393-93f6-4d53-95b2-d7a61a6f8d25 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.010440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.013690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.014230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.014671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] PATH_INFO: `/v3/projects/95ec5d0aec684023a5b75ab0732b70cf/users/18a83c0181b24560a0917a719da69522/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.025915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.026824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.027252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.027670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.028603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.033433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.040584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ec5d0aec684023a5b75ab0732b70cf, user_id=18a83c0181b24560a0917a719da69522, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.049009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.096201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 882/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:40 2022] PUT /identity/v3/projects/95ec5d0aec684023a5b75ab0732b70cf/users/18a83c0181b24560a0917a719da69522/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:41.099463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.106315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:41.120219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 917/1799] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:40 2022] POST /identity/v3/projects => generated 373 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:41.134149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.150600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:41.207264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c5f7d-f1f7-4941-a343-dd14f72382fd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.247567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:41.331855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.332540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.333430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.349086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.351150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9d45-73e3-4a1f-89b5-2fb7d4f9afe7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.394079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.394953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.395381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.395819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.396620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.400052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfd98-3bc4-4e4d-bf61-4e3ad1518a45 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.460850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.466712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.479603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 883/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:41.482340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.495940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13575fe8-b1c6-4743-9b4f-1c5bde91c941 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.514858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 918/1801] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/users => generated 292 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:41.516763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.518370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.518904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.524178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.527835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.528124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.528448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.529106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.536466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.569857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] MFA Rules not processed for user `18a83c0181b24560a0917a719da69522`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:41.582549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:41.597338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 884/1802] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:41.603849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.726313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 919/1803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:41.737026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.751489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f405b-6389-41b5-9f06-2532c319266e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.756964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.758818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.758818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.758818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.759053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.760913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.771082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:41.783330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed776-f9df-4211-8a11-03a89a37d0a4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.796589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.797626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.798150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.798643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.799445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.801376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.807680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 885/1804] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:41.812748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.816292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:41.818777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 920/1805] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:41.819880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.848781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de783d3-b04e-460f-bbee-94762fdd0f38 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.863423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.864097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.864378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.864832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.865473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.867847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.920546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 921/1806] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:41.923292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:41.949867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54962-81a7-4585-9ae8-419343c465b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:41.957274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:41.966566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:41.967159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:41.967606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:41.968518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:41.972482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:41.997603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dbc33-2801-4ae4-9e2e-8eb531e8ad54 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.020838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.025964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.028665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.029406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.035843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:42.072495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 922/1807] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:41 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:42.073445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.186293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.188270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.212087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cdd24-1658-444e-b944-178a295c1d7c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.221637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 886/1808] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:42.221637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.224117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.224820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.225143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.226036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.228228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.233519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.237938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:42.247414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0562b7-c599-4292-bfb3-ccd3d1ccb126 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.257671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 923/1809] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:42.259249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.261602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.262442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.262729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.263005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] PATH_INFO: `/v3/projects/22edde3ef6d746b4a45977afaf0c9747/users/f16503f8cdae4e4b9ace139cddc9d084/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.289249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dfdc-27ff-422f-9e3b-4bc3c3293e6b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.304467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22edde3ef6d746b4a45977afaf0c9747, user_id=f16503f8cdae4e4b9ace139cddc9d084, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.306995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.307626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.307911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.308186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.308840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.315191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.317566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.353916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 924/1810] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:42.355292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 887/1811] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:42 2022] PUT /identity/v3/projects/22edde3ef6d746b4a45977afaf0c9747/users/f16503f8cdae4e4b9ace139cddc9d084/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:42.356183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.359202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.392754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3618a-21b3-4c1c-8d6f-141c860f1824 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.542210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.544941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.545114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44799c-6910-4d56-8964-17a72117005e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.545973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.546525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.549662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.554380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.554567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.555754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.556034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.556309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] PATH_INFO: `/v3/projects/7ff912866cc24dc79931bca4f872168f/users/48d71c0a54fe4d818b746e75510fab41/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.595246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff912866cc24dc79931bca4f872168f, user_id=48d71c0a54fe4d818b746e75510fab41, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.598109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.635061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 925/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:42 2022] POST /identity/v3/users => generated 303 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:42.637533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.641948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 888/1813] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:42 2022] PUT /identity/v3/projects/7ff912866cc24dc79931bca4f872168f/users/48d71c0a54fe4d818b746e75510fab41/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:42.641948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.655958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:42.663673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d9aa-347a-413f-a1ab-7161f6db5071 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.802190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.804775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.804972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.805282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] PATH_INFO: `/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a/users/b629434b9dbe4c7d83801eb28fd00bc1/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.841463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7e279-2691-4a88-9af4-31efac075a54 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:42.846350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0628d90bb8d4aa39660b26dfcd30b4a, user_id=b629434b9dbe4c7d83801eb28fd00bc1, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.849754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.856400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:42.857251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:42.857646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:42.858024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:42.859600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:42.862227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:42.887050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 926/1814] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:42 2022] PUT /identity/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a/users/b629434b9dbe4c7d83801eb28fd00bc1/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:42.888204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.892416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 889/1815] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:42.892968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:42.927292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0305-d83c-407b-b3e6-5ee3568eba97 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.098538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f596bd-1ce6-47a5-8511-dca5faae3161 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.115699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.116401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.116686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.116966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.118230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.119857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.121435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:43.135351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.136358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.136543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.137281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.137539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.144614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.171794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 927/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:43.172709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.183360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 890/1817] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:43.189460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.201496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ea87-0dfd-41eb-8549-e06e7fc22b17 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.221738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.222436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.222815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.223121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.223833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.225786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.250349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cf332-7f0f-47ee-b200-2f386d0dc36c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.251267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 928/1818] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:43.252480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.271115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da018c7-bd5e-4906-bc24-7fe1b745455d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.274560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.275308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.275668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.275982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] PATH_INFO: `/v3/projects/22edde3ef6d746b4a45977afaf0c9747/users/f16503f8cdae4e4b9ace139cddc9d084/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.279965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22edde3ef6d746b4a45977afaf0c9747, user_id=f16503f8cdae4e4b9ace139cddc9d084, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.285263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.286000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.286291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.286731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] PATH_INFO: `/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b/users/70135f462d9a4d43afcd010f81e8e181/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.289922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.322266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 891/1819] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:43 2022] PUT /identity/v3/projects/22edde3ef6d746b4a45977afaf0c9747/users/f16503f8cdae4e4b9ace139cddc9d084/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:43.323293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.325340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f74d5320c3c44ada9fc072f82b9a32b, user_id=70135f462d9a4d43afcd010f81e8e181, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.331738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.392630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 929/1820] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:43 2022] PUT /identity/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b/users/70135f462d9a4d43afcd010f81e8e181/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:43.402671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.500218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8ff7-989f-43bb-9837-bf637806b827 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.607510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:43.641490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281b83-b248-4cdb-9ba4-c17f4f9c55d9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.657593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.658580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.658866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.659211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] PATH_INFO: `/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a/users/b629434b9dbe4c7d83801eb28fd00bc1/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.664010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0628d90bb8d4aa39660b26dfcd30b4a, user_id=b629434b9dbe4c7d83801eb28fd00bc1, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.670909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa84b6-317c-40c7-8191-033ac2ff8b87 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.699131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.699853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.700370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.700699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] PATH_INFO: `/v3/projects/7ff912866cc24dc79931bca4f872168f/users/48d71c0a54fe4d818b746e75510fab41/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.706544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff912866cc24dc79931bca4f872168f, user_id=48d71c0a54fe4d818b746e75510fab41, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.706544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.716316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 930/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:43 2022] PUT /identity/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a/users/b629434b9dbe4c7d83801eb28fd00bc1/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:43.719651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034335d-87b3-4f87-a3bc-d964fa41366e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.721290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034335d-87b3-4f87-a3bc-d964fa41366e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.722605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034335d-87b3-4f87-a3bc-d964fa41366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.754174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 892/1822] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:43 2022] PUT /identity/v3/projects/7ff912866cc24dc79931bca4f872168f/users/48d71c0a54fe4d818b746e75510fab41/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:43.762225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:43.839463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3034335d-87b3-4f87-a3bc-d964fa41366e None None] MFA Rules not processed for user `f16503f8cdae4e4b9ace139cddc9d084`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:43.840814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3034335d-87b3-4f87-a3bc-d964fa41366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:43.940033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9976c-0502-484b-92dc-019ac0ab0db2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:43.951331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:43.952117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.952506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.952883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:43.953671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:43.956044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980e90-04be-4f1e-9893-5b193ae53c76 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:43.981772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 893/1823] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:43.986468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:43.988855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:43.989298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:44.086537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 931/1824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:44.087105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077457c-6a88-46bb-b2f2-8ed6cd7e685f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:44.088309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077457c-6a88-46bb-b2f2-8ed6cd7e685f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:44.089309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077457c-6a88-46bb-b2f2-8ed6cd7e685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:44.094084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] MFA Rules not processed for user `b629434b9dbe4c7d83801eb28fd00bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:44.095783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:44.255188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2077457c-6a88-46bb-b2f2-8ed6cd7e685f None None] MFA Rules not processed for user `48d71c0a54fe4d818b746e75510fab41`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:44.257553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2077457c-6a88-46bb-b2f2-8ed6cd7e685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:44.340399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 894/1825] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:44.342395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:44.380983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:44.388267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d430c0-16db-4a35-9454-bd1ad5b6f227 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:44.407146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:44.407757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:44.410145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:44.410455 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] PATH_INFO: `/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b/users/70135f462d9a4d43afcd010f81e8e181/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:44.413413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f74d5320c3c44ada9fc072f82b9a32b, user_id=70135f462d9a4d43afcd010f81e8e181, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:44.416407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:44.475039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 895/1826] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:44 2022] PUT /identity/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b/users/70135f462d9a4d43afcd010f81e8e181/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:44.475952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:44.585524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 932/1827] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:44.589500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b4162-eb10-4506-bf40-facd6ecd3624 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:44.592253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b4162-eb10-4506-bf40-facd6ecd3624 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:44.592555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b4162-eb10-4506-bf40-facd6ecd3624 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:44.600546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 933/1828] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:11:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:44.606415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b4162-eb10-4506-bf40-facd6ecd3624 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:44.712251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:44.820640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37f80d-a981-45bb-8b02-a0cd21177a0c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:44.827570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b4162-eb10-4506-bf40-facd6ecd3624 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:44.843223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:44.844025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:44.844315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:44.844594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:44.854817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:44.855509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:44.855792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:44.856077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.033851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:45.035329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebd082-d5a1-457a-8d60-57630e2d121a service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:45.049073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:45.051165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00293b-a5e3-45d7-b5ac-f4d093756f46 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:45.059942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 934/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:45.063793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.064084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.066009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.103611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 896/1830] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:45.108130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.108649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.112200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.138678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] MFA Rules not processed for user `70135f462d9a4d43afcd010f81e8e181`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:45.139939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:45.184200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:45.186093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:45.319619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 897/1831] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:45.322297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:45.343234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5491ee-f6ee-4024-8080-7ee8a0f58cce None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:45.358189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:45.358427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:45.361073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.361862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.362597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.381288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 935/1832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:45.381288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:45.491090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:45.494016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:45.525117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 898/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:45.530368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:45.543070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf5efc-0b48-4bfb-95a7-24fa481c4072 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:45.549172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:45.550040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.550924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.551215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] PATH_INFO: `/v3/users/3b8f91ad87bc4be1b91fa9fce5c6c94e` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.553002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8f91ad87bc4be1b91fa9fce5c6c94e)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:45.556293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:45.565759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245ebe0-3a26-4675-b411-f1970ce66d70 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:45.578391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:45.579193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.579550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.579878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.612637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:45.689282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8f91ad87bc4be1b91fa9fce5c6c94e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:45.705768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8f91ad87bc4be1b91fa9fce5c6c94e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:45.715352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8f91ad87bc4be1b91fa9fce5c6c94e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:45.731582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8f91ad87bc4be1b91fa9fce5c6c94e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:45.732298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8f91ad87bc4be1b91fa9fce5c6c94e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:45.758866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 936/1834] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:45 2022] DELETE /identity/v3/users/3b8f91ad87bc4be1b91fa9fce5c6c94e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:45.760174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:45.762377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:45.770313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:45.772191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:45.800445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 899/1835] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:45.816300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:45.845782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1b02-1756-46c8-84c7-a24f588c1cff service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:45.990103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:45.990771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:45.991512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:45.991512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:45.998458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.002771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945808-c2c5-4d77-a4ba-9bc86da13bce admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:46.014210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:46.014946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:46.015241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:46.015625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:46.018245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.041384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:46.043535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a649-0c0c-4e08-be7f-40de7ac13a71 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:46.072477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 937/1836] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:46.077440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:46.077741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:46.078087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:46.106750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:46.108904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:46.120630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:46.136137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 900/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:46.155520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:46.158555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.258456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:46.260113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.276011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132674-caff-40f9-8db9-625d94e6e76d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:46.286642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:46.288693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:46.289680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:46.289966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:46.292444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.336504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 938/1838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:46.356988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:46.359349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:46.453543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:46.466189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:46.470581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:46.513743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 901/1839] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:46.563475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559df29-cc3d-4a2c-8bf4-8b8053222b14 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:46.570355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:46.571232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:46.571544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:46.571824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:46.588103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:46.590215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:46.606616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 939/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:47.532028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:47.535376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:47.576691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624788-01ec-4a12-8df3-31028e912adf service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:47.599139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:47.600141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:47.602446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:47.603519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] PATH_INFO: `/v3/projects/3ca3b267842c46bdb7e1fcdfc455311e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:47.605748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca3b267842c46bdb7e1fcdfc455311e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:47.611802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:47.627825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:47.629371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:47.664919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37e8e-bf17-4b0c-ae80-e4b80a8c4442 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:47.681920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:47.682884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:47.683356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:47.683822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] PATH_INFO: `/v3/users/c9846a907e354e649b0605ca4fb37ec2` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:47.686018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9846a907e354e649b0605ca4fb37ec2)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:47.694091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:47.705036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca3b267842c46bdb7e1fcdfc455311e', 'request_id': 'req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.716863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca3b267842c46bdb7e1fcdfc455311e', 'request_id': 'req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.726672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca3b267842c46bdb7e1fcdfc455311e', 'request_id': 'req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.741825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] The token cache is being invalidate because project 3ca3b267842c46bdb7e1fcdfc455311e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:47.742153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.743382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.745407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 902/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:47 2022] DELETE /identity/v3/projects/3ca3b267842c46bdb7e1fcdfc455311e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:47.749340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:47.751299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:47.781405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9846a907e354e649b0605ca4fb37ec2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.809026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9846a907e354e649b0605ca4fb37ec2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.811305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9846a907e354e649b0605ca4fb37ec2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.823936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9846a907e354e649b0605ca4fb37ec2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.824896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-311ebe00-3dc9-41b9-840f-9d613b6a69dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9846a907e354e649b0605ca4fb37ec2'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:47.842998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 940/1842] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:47 2022] DELETE /identity/v3/users/c9846a907e354e649b0605ca4fb37ec2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:47.847936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:47.850204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:47.850713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:47.867052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6c51-7ee6-427f-876b-b065e8ad53f3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:47.877154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:47.880114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:47.895695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:47.954010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 941/1843] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:47.956222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:47.956983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:47.958233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:47.958552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] PATH_INFO: `/v3/users/b629434b9dbe4c7d83801eb28fd00bc1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:47.964451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:47.964618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b629434b9dbe4c7d83801eb28fd00bc1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:47.965973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:47.966552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:47.998674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:48.021464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b629434b9dbe4c7d83801eb28fd00bc1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.029722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07ed0-0dc4-46e6-a7ba-079f77f6e365 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:48.033517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:48.033791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b629434b9dbe4c7d83801eb28fd00bc1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.034129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:48.034409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:48.034682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:48.041698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b629434b9dbe4c7d83801eb28fd00bc1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.042314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b629434b9dbe4c7d83801eb28fd00bc1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.043583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9bcd7a6a-484e-430e-af1b-fe9001457ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b629434b9dbe4c7d83801eb28fd00bc1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.045138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:48.046629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:48.056285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 942/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:11:48.056788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 903/1845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:47 2022] DELETE /identity/v3/users/b629434b9dbe4c7d83801eb28fd00bc1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:48.511901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:48.513650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:48.569426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d608-6215-40d5-9a2c-6ad2b8352f54 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:48.669383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:48.670273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:48.670561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:48.670838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] PATH_INFO: `/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:48.672014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0628d90bb8d4aa39660b26dfcd30b4a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:48.674001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:48.730426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0628d90bb8d4aa39660b26dfcd30b4a', 'request_id': 'req-21503ff1-e8f6-4680-8225-8341f72b2e71'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.740209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0628d90bb8d4aa39660b26dfcd30b4a', 'request_id': 'req-21503ff1-e8f6-4680-8225-8341f72b2e71'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.749293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0628d90bb8d4aa39660b26dfcd30b4a', 'request_id': 'req-21503ff1-e8f6-4680-8225-8341f72b2e71'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.755723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:48.771464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] The token cache is being invalidate because project d0628d90bb8d4aa39660b26dfcd30b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:48.772071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.774708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:48.779866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 943/1846] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:48 2022] DELETE /identity/v3/projects/d0628d90bb8d4aa39660b26dfcd30b4a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:48.781566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:48.782042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:48.782187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:48.808914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:48.810517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:48.875455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:48.877171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:48.921805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 904/1847] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:48.922914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:48.925439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:48.939945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536f0b-e055-4ea0-b5d2-f100c3497a86 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:48.946115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:48.946832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:48.947179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:48.947452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] PATH_INFO: `/v3/projects/d84310baa39e4480b939f477fdaef629` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:48.948930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84310baa39e4480b939f477fdaef629)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:48.951379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:48.967713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503ff1-e8f6-4680-8225-8341f72b2e71 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:48.973640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:48.974279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:48.974555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:48.974826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] PATH_INFO: `/v3/users/06dc56e54a75471aaff8e42b6815ca37` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:48.976916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06dc56e54a75471aaff8e42b6815ca37)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:48.979447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.007972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84310baa39e4480b939f477fdaef629', 'request_id': 'req-1335107a-c92e-4e7b-9a95-75c407aa19a2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.018545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84310baa39e4480b939f477fdaef629', 'request_id': 'req-1335107a-c92e-4e7b-9a95-75c407aa19a2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.029522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84310baa39e4480b939f477fdaef629', 'request_id': 'req-1335107a-c92e-4e7b-9a95-75c407aa19a2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.043200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] The token cache is being invalidate because project d84310baa39e4480b939f477fdaef629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:49.043475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.044327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1335107a-c92e-4e7b-9a95-75c407aa19a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.045201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06dc56e54a75471aaff8e42b6815ca37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.046210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 905/1848] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:48 2022] DELETE /identity/v3/projects/d84310baa39e4480b939f477fdaef629 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:49.047449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e9b1-732b-4e0f-8d07-91c64631b302 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.047808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e9b1-732b-4e0f-8d07-91c64631b302 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.048217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127e9b1-732b-4e0f-8d07-91c64631b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.066991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06dc56e54a75471aaff8e42b6815ca37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.068498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06dc56e54a75471aaff8e42b6815ca37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.073259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6127e9b1-732b-4e0f-8d07-91c64631b302 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:49.074168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6127e9b1-732b-4e0f-8d07-91c64631b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.087657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06dc56e54a75471aaff8e42b6815ca37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.088320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06dc56e54a75471aaff8e42b6815ca37'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.108082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:49.118584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 944/1849] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:48 2022] DELETE /identity/v3/users/06dc56e54a75471aaff8e42b6815ca37 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:49.119556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.122909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.190040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 906/1850] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:49.192382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.192866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.194722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.219068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17b0f6-9938-49a1-ae74-65ed9060223d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.224570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.225474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.225583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.225825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] PATH_INFO: `/v3/users/48d71c0a54fe4d818b746e75510fab41` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.228020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d71c0a54fe4d818b746e75510fab41)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.230308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.247831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:49.248370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:49.249811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.274094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 907/1851] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:49.278358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.298619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb4bc-bb74-4111-b8d0-ee8fdb3e6712 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.309468 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d71c0a54fe4d818b746e75510fab41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.311805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.313458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.313834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.314318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.315066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:49.315444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.317671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.334393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d71c0a54fe4d818b746e75510fab41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.335575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d71c0a54fe4d818b746e75510fab41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.347778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 908/1852] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:49.347778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.349124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.353795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d71c0a54fe4d818b746e75510fab41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.354560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d71c0a54fe4d818b746e75510fab41'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:49.376044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 945/1853] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:49 2022] DELETE /identity/v3/users/48d71c0a54fe4d818b746e75510fab41 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:49.377098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.379218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.483975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e689bf-06fe-41a0-aa2e-ba2fecce74d5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.489366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d566ccc-2360-488c-9fc7-1f29cc320473 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.496250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.497023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.497450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.497846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.498601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.501864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.566129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 946/1854] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:49 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:49.567504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.591294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.592052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.592398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.592684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.597744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:49.645060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.649121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.677170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 909/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:49.710641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33011c4-053d-45d3-a7cd-ad33a00e4115 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.732805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.733559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.733863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.734210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.734807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.736973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.778868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 947/1856] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:49 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:49.782105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.799123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d077eaf-8441-4a5f-a744-d26636380c62 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.810398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.811287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.811581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.812158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.813004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.825504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.836215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 910/1857] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:49.837760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.849626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367acf0-1dc8-4859-8fee-d0af63f835a2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.857825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.858549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.859016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.859387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.860177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.862588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b1f2-eb13-43dc-8f4c-575dffe33171 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:49.864712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:49.883775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 948/1858] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:49.884042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:49.903893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd95e4-09df-46e8-97fb-37b228a64266 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:49.919513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:49.920910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:49.922905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:49.923411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] PATH_INFO: `/v3/projects/3a5ac5f54f7142b884667194eeb89518/users/e4f5b91d3c3948269c40b683cf6b4a23/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:49.960863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5ac5f54f7142b884667194eeb89518, user_id=e4f5b91d3c3948269c40b683cf6b4a23, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:49.964654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.004271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 911/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:49 2022] PUT /identity/v3/projects/3a5ac5f54f7142b884667194eeb89518/users/e4f5b91d3c3948269c40b683cf6b4a23/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:50.005719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.006014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.006300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.061332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] MFA Rules not processed for user `e4f5b91d3c3948269c40b683cf6b4a23`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:50.063410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:50.198172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.200523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:50.269070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 949/1860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:50.272951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.276189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:50.323305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb58ab-689d-4641-bfab-a570604b6cc3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.329998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.330912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.331349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.331737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] PATH_INFO: `/v3/projects/7ff912866cc24dc79931bca4f872168f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.333682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff912866cc24dc79931bca4f872168f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.336631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.397618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff912866cc24dc79931bca4f872168f', 'request_id': 'req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:50.411556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff912866cc24dc79931bca4f872168f', 'request_id': 'req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:50.421839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff912866cc24dc79931bca4f872168f', 'request_id': 'req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:50.437482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] The token cache is being invalidate because project 7ff912866cc24dc79931bca4f872168f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:50.437884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:50.438671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2e0ac8f5-df7d-4193-86e8-f6ed1c12b8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:50.444350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 912/1861] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:50 2022] DELETE /identity/v3/projects/7ff912866cc24dc79931bca4f872168f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:50.444494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c48b67-44e2-41cc-8032-4f5e8f4e1ae9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.446686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eecd3-f920-405a-90d6-4690bd849b1c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.447079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eecd3-f920-405a-90d6-4690bd849b1c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.447543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eecd3-f920-405a-90d6-4690bd849b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.477665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4f2eecd3-f920-405a-90d6-4690bd849b1c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:50.479274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4f2eecd3-f920-405a-90d6-4690bd849b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:50.557896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.558682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.558969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.560154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.562639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.565612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.586962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 913/1862] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:50.589261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.589825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.590060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.615676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 950/1863] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/projects => generated 381 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:50.620330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.624961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:50.645940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:50.649365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:50.679588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:50.767954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c306-8d56-4c5f-865d-b38fcb7d7c02 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.782518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.783854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.784149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.784450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.785092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.788729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.831150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 914/1864] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:50.832681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.845592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 951/1865] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:50.850011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.850764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:50.863862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f95166-640f-4ece-8d75-239617d552f9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.873946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.875540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.876140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.876926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.878156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:50.878689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.880716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3deb05-80bc-44b3-9e01-195e2599e629 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.882447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.894621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.895396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.895796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.896358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.897367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.900548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.915858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 915/1866] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:50.917020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.924893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 952/1867] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:50.926256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:50.953274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807dbc4-c26d-4058-a832-1c8bd30f628f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.963119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.963119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.963119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.963119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:50.963743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:50.967856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:50.968330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2165-568d-4760-ab4c-5496d0674d4b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:50.987221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:50.988150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:50.988276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:50.988477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] PATH_INFO: `/v3/projects/4fe179a27bbe4df095d93eb6dbd67685/users/d12979fc917a42c7bba8de43e2368f52/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.005128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 916/1868] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:50 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:51.010723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.025174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe179a27bbe4df095d93eb6dbd67685, user_id=d12979fc917a42c7bba8de43e2368f52, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.028505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.061035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 953/1869] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:50 2022] PUT /identity/v3/projects/4fe179a27bbe4df095d93eb6dbd67685/users/d12979fc917a42c7bba8de43e2368f52/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:51.063119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.187363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e1d5b-45b4-41bb-a881-625f1f7a9c6d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.193693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.194545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.196440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.197325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.199163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.199277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c130-0550-408e-a5a0-ca60f8f3dedb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.200247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.204043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.204894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.205451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.205920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.206885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.208923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.228822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 954/1870] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:51.229745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.236717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.237183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 917/1871] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:51 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:51.238064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.242010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.269537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7091f17-6930-4ccc-9678-da37d2794dd8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.277834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.278942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.279563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.280206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] PATH_INFO: `/v3/projects/894c6d1903394f7aaf5aa694965e7f8b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.281541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd524e09-70cb-4c7d-833b-1b0c53a53c94 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.282456 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=894c6d1903394f7aaf5aa694965e7f8b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.285012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.305201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.305885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.306170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.306447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] PATH_INFO: `/v3/users/18a83c0181b24560a0917a719da69522` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.310006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a83c0181b24560a0917a719da69522)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.311972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.429448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894c6d1903394f7aaf5aa694965e7f8b', 'request_id': 'req-4339cd63-57c4-427e-999f-bba3911d6e9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.445779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894c6d1903394f7aaf5aa694965e7f8b', 'request_id': 'req-4339cd63-57c4-427e-999f-bba3911d6e9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.449011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a83c0181b24560a0917a719da69522'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.469476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894c6d1903394f7aaf5aa694965e7f8b', 'request_id': 'req-4339cd63-57c4-427e-999f-bba3911d6e9b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.471559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:51.489582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a83c0181b24560a0917a719da69522'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.507275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a83c0181b24560a0917a719da69522'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.508460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a83c0181b24560a0917a719da69522'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.509265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a83c0181b24560a0917a719da69522'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.510043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] The token cache is being invalidate because project 894c6d1903394f7aaf5aa694965e7f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:51.510426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.512504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.518513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 955/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:51 2022] DELETE /identity/v3/projects/894c6d1903394f7aaf5aa694965e7f8b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:51.519491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.527008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.544101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 918/1873] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:51 2022] DELETE /identity/v3/users/18a83c0181b24560a0917a719da69522 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:51.544787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.546984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.604650 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:51.650625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339cd63-57c4-427e-999f-bba3911d6e9b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.653806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07105727-e946-41a4-bb8b-1eca73e46da3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.658036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.659011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.659874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.659874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] PATH_INFO: `/v3/projects/4fe179a27bbe4df095d93eb6dbd67685/users/d12979fc917a42c7bba8de43e2368f52/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.661885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe179a27bbe4df095d93eb6dbd67685, user_id=d12979fc917a42c7bba8de43e2368f52, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.662592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.663634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.664712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.665672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.665787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e715b-373a-460d-97b1-a0b10a66f77d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.666476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.669218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.681417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 919/1874] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:51.682615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.684202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.693507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 956/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:51 2022] PUT /identity/v3/projects/4fe179a27bbe4df095d93eb6dbd67685/users/d12979fc917a42c7bba8de43e2368f52/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:51.693507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.693507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.693507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.709781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dd6b4-b79b-464a-b359-aeca8e52cc9d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.718507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:51.719959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.783538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.784696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.784988 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.785313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] PATH_INFO: `/v3/users/e49c369aaaae4c1db9cc67dc4da68fc9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.786567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49c369aaaae4c1db9cc67dc4da68fc9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.790734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.803607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 957/1876] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:51.804236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.806043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.827318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948af24-29bc-4f85-b0ca-4d230265504e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:51.833657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:51.834372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.835256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.835256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.835722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:51.837552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f42f7-2858-4ac0-8d3a-42bc4625611c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:51.851203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 958/1877] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:51.853573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:51.854246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:51.854772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:51.864141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49c369aaaae4c1db9cc67dc4da68fc9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.880692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49c369aaaae4c1db9cc67dc4da68fc9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.889500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] MFA Rules not processed for user `d12979fc917a42c7bba8de43e2368f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:51.890853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.891213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49c369aaaae4c1db9cc67dc4da68fc9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.891937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49c369aaaae4c1db9cc67dc4da68fc9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.892534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49c369aaaae4c1db9cc67dc4da68fc9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:51.907292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 920/1878] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:51 2022] DELETE /identity/v3/users/e49c369aaaae4c1db9cc67dc4da68fc9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:51.910795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:51.910795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:51.990993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:52.021093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 959/1879] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:52.021093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.021093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.045602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d7edf-88fd-47e7-8b26-df673c80ffa7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.048594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:52.062038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e7f1-0364-4c76-895e-d19ea283e6ac admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.089041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.089041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.089041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.089041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.091670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.160400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.161091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.161399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.161681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] PATH_INFO: `/v3/projects/41cd4c4b2c0e435980782fafafb8d402/users/10cec534c36842a68f17fc5aa7e09543/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.177542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41cd4c4b2c0e435980782fafafb8d402, user_id=10cec534c36842a68f17fc5aa7e09543, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.181180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.182952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.184408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6dd0b-2734-4de9-8766-503ae886c4b2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.194932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 960/1880] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:52 2022] PUT /identity/v3/projects/41cd4c4b2c0e435980782fafafb8d402/users/10cec534c36842a68f17fc5aa7e09543/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:52.195639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 921/1881] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:52.196613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.198585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.205439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.205729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.206011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.261102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] MFA Rules not processed for user `10cec534c36842a68f17fc5aa7e09543`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:52.262359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.270477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e8c6-c669-4065-8d39-4a0e093a1267 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.275065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.276369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.276828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.277200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.371403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.373526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.384407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 961/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:52.388622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 922/1883] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:52.394476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.403731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.405159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.472582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:52.496247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1bbac-1c4d-4f70-a419-05104f65608e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.501406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.502050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.502330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.502608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] PATH_INFO: `/v3/projects/7f571c67fa31465baf46b1d28743acbe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.503762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f571c67fa31465baf46b1d28743acbe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.505786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.524059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af648b1f-9cbb-4f0b-a159-5c43a8cf696b service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.525478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.526799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.526799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.526799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.527644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.529996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.575648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 962/1884] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:52 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:52.576750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:52.577985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.612172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f571c67fa31465baf46b1d28743acbe', 'request_id': 'req-f512bced-0839-4acc-b1c1-0f5e6356cb8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.631906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f571c67fa31465baf46b1d28743acbe', 'request_id': 'req-f512bced-0839-4acc-b1c1-0f5e6356cb8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.646991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f571c67fa31465baf46b1d28743acbe', 'request_id': 'req-f512bced-0839-4acc-b1c1-0f5e6356cb8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.666761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] The token cache is being invalidate because project 7f571c67fa31465baf46b1d28743acbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:52.667059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.667891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.669814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 923/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:52 2022] DELETE /identity/v3/projects/7f571c67fa31465baf46b1d28743acbe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:11:52.671363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d89d-9b54-4f7d-aae6-ea026ab0fafe admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.674521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.677073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.784998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.785990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.786474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.786900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.790831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.794820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.827401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bced-0839-4acc-b1c1-0f5e6356cb8b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.835339 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.836735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.837390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.837975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] PATH_INFO: `/v3/users/1269bf6303a7457fbe3dad485c298c53` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.840248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1269bf6303a7457fbe3dad485c298c53)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.849393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 963/1886] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:52 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:52.850645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.852811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.859220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:52.893542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4474f-8beb-4a4e-9521-174a265d0ff8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:52.917437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:52.918057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:52.918338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:52.918610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:52.920657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:52.922637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:52.931234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1269bf6303a7457fbe3dad485c298c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.947036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1269bf6303a7457fbe3dad485c298c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.962097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1269bf6303a7457fbe3dad485c298c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.963139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1269bf6303a7457fbe3dad485c298c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.963986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1269bf6303a7457fbe3dad485c298c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:52.971150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 964/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:52.971999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:52.979360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.002222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 924/1888] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:52 2022] DELETE /identity/v3/users/1269bf6303a7457fbe3dad485c298c53 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:53.007225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b469f2d-90b2-4158-b647-fd3c54eba13b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.050675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.052711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.154615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:53.178884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:53.227538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.227538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.227538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.227538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.228134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.228134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.255226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99331-f70d-4888-a5f0-37b0fc18ead5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.268853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12979fc917a42c7bba8de43e2368f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe179a27bbe4df095d93eb6dbd67685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.271394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.271840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.272300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.274729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 965/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:53.275899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:53.276355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.276536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.280889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.281893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.304169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 925/1890] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:11:53.307031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.324910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1cd8-9808-4912-80f7-e1cc7c976a05 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.330824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c994ca-5ec2-464c-a2b3-f3bed143c166 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.333716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.334461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.334752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.335095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] PATH_INFO: `/v3/projects/c4bc20c2b70843a2b63a9792fef34863/users/370682e0a83a4ab8a18415c9fbe72752/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.348977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.349297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.349588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.349869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] PATH_INFO: `/v3/projects/95ec5d0aec684023a5b75ab0732b70cf` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.352453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ec5d0aec684023a5b75ab0732b70cf)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.354426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.373951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bc20c2b70843a2b63a9792fef34863, user_id=370682e0a83a4ab8a18415c9fbe72752, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.378325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.422819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 926/1891] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:53 2022] PUT /identity/v3/projects/c4bc20c2b70843a2b63a9792fef34863/users/370682e0a83a4ab8a18415c9fbe72752/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:53.434182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.459365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ec5d0aec684023a5b75ab0732b70cf', 'request_id': 'req-97129eea-ea20-4f4d-9828-dbfb1fb55030'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.475050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ec5d0aec684023a5b75ab0732b70cf', 'request_id': 'req-97129eea-ea20-4f4d-9828-dbfb1fb55030'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.496514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ec5d0aec684023a5b75ab0732b70cf', 'request_id': 'req-97129eea-ea20-4f4d-9828-dbfb1fb55030'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.515808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] The token cache is being invalidate because project 95ec5d0aec684023a5b75ab0732b70cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:53.516149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.516866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97129eea-ea20-4f4d-9828-dbfb1fb55030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.519012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 966/1892] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:53 2022] DELETE /identity/v3/projects/95ec5d0aec684023a5b75ab0732b70cf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:53.520860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c87e-3f56-4e57-a765-1ba6366cc2af None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.521141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c87e-3f56-4e57-a765-1ba6366cc2af None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.521621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505c87e-3f56-4e57-a765-1ba6366cc2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.562549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49746ef-c89c-4daf-996c-9a12acc670a2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.580140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12979fc917a42c7bba8de43e2368f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe179a27bbe4df095d93eb6dbd67685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.582475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.583540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.583929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.584688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.586454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2505c87e-3f56-4e57-a765-1ba6366cc2af None None] MFA Rules not processed for user `370682e0a83a4ab8a18415c9fbe72752`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:53.586953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.588743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2505c87e-3f56-4e57-a765-1ba6366cc2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.666601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 927/1893] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:53 2022] POST /identity/v3/projects => generated 354 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:53.667747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.671589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.718785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 967/1894] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:53.725888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.726823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.727139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.728544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 968/1895] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:11:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:11:53.734617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.738776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.782281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d281220-4c22-47a2-bfce-5e7080c5c703 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.791126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.791775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.792122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.792573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] PATH_INFO: `/v3/users/70135f462d9a4d43afcd010f81e8e181` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.794651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=70135f462d9a4d43afcd010f81e8e181)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.807475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.853806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:53.872394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:53.888946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7288342-959a-48b0-82f6-564d22f946ed None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.898628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12979fc917a42c7bba8de43e2368f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe179a27bbe4df095d93eb6dbd67685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.899553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.899916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.901035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.901322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:53.901719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.901974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70135f462d9a4d43afcd010f81e8e181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.903735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.919287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 969/1896] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:53.920261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:53.922442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:53.933523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70135f462d9a4d43afcd010f81e8e181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.946455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd03c-2a42-461f-a981-2932866e7248 tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:53.952819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70135f462d9a4d43afcd010f81e8e181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.954881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70135f462d9a4d43afcd010f81e8e181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.955932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cfd92ada-729f-4442-9faf-eef8de9da7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70135f462d9a4d43afcd010f81e8e181'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:53.961137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:53.962105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.962532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.962933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:53.964314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:53.967124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:53.981324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 928/1897] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:53 2022] DELETE /identity/v3/users/70135f462d9a4d43afcd010f81e8e181 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:53.982418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:53.982761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:53.983127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.013828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 970/1898] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:53 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:54.015211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.017175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.017397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:54.018563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.096939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58efc2-f341-48e7-93c6-d349ffda882a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.104053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.105879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.106170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.106449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] PATH_INFO: `/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.108111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c263775f57d4c67b3cf2a2079b65ad6)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.110076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.113058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 929/1899] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:54.114189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.115830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.174379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c263775f57d4c67b3cf2a2079b65ad6', 'request_id': 'req-f39eb422-4416-4579-938e-d609efd85a1c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.180739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c263775f57d4c67b3cf2a2079b65ad6', 'request_id': 'req-f39eb422-4416-4579-938e-d609efd85a1c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.191162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c263775f57d4c67b3cf2a2079b65ad6', 'request_id': 'req-f39eb422-4416-4579-938e-d609efd85a1c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.196590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0e0a-6bf9-42ae-8a3a-ad3d4d8f7a48 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.208058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] The token cache is being invalidate because project 5c263775f57d4c67b3cf2a2079b65ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:54.208410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.209050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.212153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 971/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:54 2022] DELETE /identity/v3/projects/5c263775f57d4c67b3cf2a2079b65ad6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:54.212950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.214337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.247807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:54.265947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd12979fc917a42c7bba8de43e2368f52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe179a27bbe4df095d93eb6dbd67685', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.266887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.267415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.267820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] PATH_INFO: `/v3/projects/e0371a43139f418ab818ca83d17e3335` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.269914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0371a43139f418ab818ca83d17e3335)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.272204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.291715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:54.298388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb422-4416-4579-938e-d609efd85a1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.306710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.308241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.308241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.308454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.309205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.311431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.336914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0371a43139f418ab818ca83d17e3335', 'request_id': 'req-5c812ade-faa9-48d0-8791-cc8614b44cff'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.340555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 972/1901] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:54 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:54.341195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.343972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.350224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0371a43139f418ab818ca83d17e3335', 'request_id': 'req-5c812ade-faa9-48d0-8791-cc8614b44cff'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.361882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0371a43139f418ab818ca83d17e3335', 'request_id': 'req-5c812ade-faa9-48d0-8791-cc8614b44cff'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.374898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] The token cache is being invalidate because project e0371a43139f418ab818ca83d17e3335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:54.375323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.376323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5c812ade-faa9-48d0-8791-cc8614b44cff tempest-VolumeQuotaClassesTest-1121005286 tempest-VolumeQuotaClassesTest-1121005286-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.378340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 930/1902] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:54 2022] DELETE /identity/v3/projects/e0371a43139f418ab818ca83d17e3335 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:54.379665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.380075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.380864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.437838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:54.439298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.477632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954f14-92eb-42cf-8e12-fadeadb6ae3d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.515564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 931/1903] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:54.518151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.522156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.541812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1bd4f-82d5-4611-9003-50aa0f11756a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.547521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.548425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.548744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.549105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.554149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.559430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.578420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 932/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:54.579910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.582085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.588662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.589905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.589905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.589905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.591671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.600134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996fd84-6793-4596-939d-eeb3ddd9186f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.606774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.606955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.607249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.607828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] PATH_INFO: `/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.609396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f74d5320c3c44ada9fc072f82b9a32b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.611799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.626035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.628117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc349e1-8be5-496e-84c3-61c035da48fc service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.647791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 973/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:54.649577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.650200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.650564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.681381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:54.682713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.687932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f74d5320c3c44ada9fc072f82b9a32b', 'request_id': 'req-1f77d1d6-5c04-4b62-a832-f36af9b3821f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.700063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f74d5320c3c44ada9fc072f82b9a32b', 'request_id': 'req-1f77d1d6-5c04-4b62-a832-f36af9b3821f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.705814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:54.707686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f74d5320c3c44ada9fc072f82b9a32b', 'request_id': 'req-1f77d1d6-5c04-4b62-a832-f36af9b3821f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.726999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] The token cache is being invalidate because project 1f74d5320c3c44ada9fc072f82b9a32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:54.727296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.728440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:54.730170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 933/1906] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:54 2022] DELETE /identity/v3/projects/1f74d5320c3c44ada9fc072f82b9a32b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:54.730982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.734353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.802161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 974/1907] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:54.805517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:54.808605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:54.833525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d1d6-5c04-4b62-a832-f36af9b3821f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.841530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.842594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.843218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.843770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] PATH_INFO: `/v3/projects/e3bc8f9389394d6b84655ce4541adf36/users/2132e6afe1e64ef7b9c43ad7d6448fc1/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.862652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836e62c-8e18-455b-9e84-8c8c12cd5761 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:54.871770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:54.872894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.873369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.873787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] PATH_INFO: `/v3/users/e4f5b91d3c3948269c40b683cf6b4a23` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.875294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f5b91d3c3948269c40b683cf6b4a23)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.878828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.882611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:54.883746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bc8f9389394d6b84655ce4541adf36, user_id=2132e6afe1e64ef7b9c43ad7d6448fc1, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:54.887066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2debf-c9f0-49ff-9f5e-52df48b9e781 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:54.917373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 934/1908] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:54 2022] PUT /identity/v3/projects/e3bc8f9389394d6b84655ce4541adf36/users/2132e6afe1e64ef7b9c43ad7d6448fc1/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:54.920337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:54.920337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:54.920478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:54.964600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:54.966889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.024395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f5b91d3c3948269c40b683cf6b4a23'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:55.050823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f5b91d3c3948269c40b683cf6b4a23'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:55.051630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f5b91d3c3948269c40b683cf6b4a23'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:55.064985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f5b91d3c3948269c40b683cf6b4a23'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:55.066304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f5b91d3c3948269c40b683cf6b4a23'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:55.086703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 975/1909] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:54 2022] DELETE /identity/v3/users/e4f5b91d3c3948269c40b683cf6b4a23 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:55.087647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.089755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.107986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 935/1910] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:55.114486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.114486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.145865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e246-a5ba-46f9-8909-b937c84617ff None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.193335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11024ae2-4c3d-459b-9e3a-53e98f9f886b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.200886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.201996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.202505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.203030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.203948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:55.204474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.206682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fadc2-1cd1-4128-b446-5fc5d4642f93 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.229403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 976/1911] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:55.233034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb775-9bd8-49f7-81b8-149e54a7f7f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.233546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb775-9bd8-49f7-81b8-149e54a7f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.233969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb775-9bd8-49f7-81b8-149e54a7f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.286994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.289493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.290800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.291649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.293880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.297704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.310389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-142bb775-9bd8-49f7-81b8-149e54a7f7f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:55.311368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-142bb775-9bd8-49f7-81b8-149e54a7f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.320814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 977/1912] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:55.322295 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.322665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.323001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.328966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 936/1913] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:55.330046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.348700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb2d83-f04f-4e0d-a151-7797d51bc75d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.354920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.355423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:55.355686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.356056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.356838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.357012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.357751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.359782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.367228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 978/1914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:55.368201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.374619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:55.379651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808345-52ca-46fb-a79c-07a813b339e0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.385937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.386747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.387145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.387741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] PATH_INFO: `/v3/projects/e3bc8f9389394d6b84655ce4541adf36/users/2132e6afe1e64ef7b9c43ad7d6448fc1/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.390566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bc8f9389394d6b84655ce4541adf36, user_id=2132e6afe1e64ef7b9c43ad7d6448fc1, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.394154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.407820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 979/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:55 2022] PUT /identity/v3/projects/e3bc8f9389394d6b84655ce4541adf36/users/2132e6afe1e64ef7b9c43ad7d6448fc1/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:55.408695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.410365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.419655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 937/1916] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:55.420613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.495914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:55.502983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43eb0c-e59f-42a1-81b9-c806bd286df9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.503545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5456b-a3e2-40d9-9dbc-548c47ae329e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.511257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.512588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.514143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.514670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.517280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:55.517683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.520158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1aa20-cde8-49a6-9bc9-3b53f0b5747d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.543631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 938/1917] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:11:55.545032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.545348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.545626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.574640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.575816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.576230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.576575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.580654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] MFA Rules not processed for user `2132e6afe1e64ef7b9c43ad7d6448fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:55.582225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.592592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.594133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.604280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 980/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:55.605126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.616092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b6b0d-4646-4e73-8fc0-d1ba3256d3a5 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.623987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.624699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.625134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.625577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.626637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.629210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.660989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 981/1919] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:55.660989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.670625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbf3f9-1b2f-4213-b1df-9d9e3182091c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.675400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.676388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.676522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.676859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.677703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.679735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.699556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 939/1920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:55.703177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.720284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 982/1921] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/projects => generated 409 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:55.721624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.723520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f462-d187-469e-a7b7-d361d7537e12 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.725275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:55.824467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.825095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.825405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.825678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.826334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.826888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7995a-b6c8-49ac-a7f3-4a755324e352 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.827934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.831198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.831816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.832128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.832403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.841085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 940/1922] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:55.842235 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.851077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:55.856647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668129-2822-408a-b752-0aeac4596a1a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.864757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.865783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.866306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.867366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.869038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.872890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.910495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 941/1923] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:55 2022] POST /identity/v3/users => generated 305 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:55.911773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.923199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a776-e486-45cf-a8f5-13a38db1860a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.927957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.929294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.929965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.930360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.930750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.930891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.931599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.933421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.945727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 983/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:55.950687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.951308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 942/1925] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:55.955152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:55.963594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b3f5-4c8d-4d2e-a211-d42cf6e23ab0 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.968925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.969769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.970170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.970533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.971934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:55.974042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:55.975296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cca37-9a8e-4ebe-b60e-510ba16e34d5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:55.987655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:55.988353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:55.988623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:55.988904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] PATH_INFO: `/v3/projects/4cb747a7cd814aa6add3dffd99e86e0c/users/e5289ead5fe24f12a34bf75472b63df1/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:55.989585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 984/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:55.994988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.006486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ea1f-f714-49f7-a685-2cc933faa23e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.014507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.015363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.020079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.020567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.022099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.024573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.028703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb747a7cd814aa6add3dffd99e86e0c, user_id=e5289ead5fe24f12a34bf75472b63df1, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.033205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.035516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:56.045249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 985/1927] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:56.046219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.048275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.069053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 943/1928] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:55 2022] PUT /identity/v3/projects/4cb747a7cd814aa6add3dffd99e86e0c/users/e5289ead5fe24f12a34bf75472b63df1/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:56.069053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.069386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c5f-439d-4da2-8f00-578e004f6aa7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.141778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.142738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.143326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.143898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] PATH_INFO: `/v3/projects/3a5ac5f54f7142b884667194eeb89518` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.145377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5ac5f54f7142b884667194eeb89518)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.147383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.149974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4dbd5-a7d4-49ff-bde4-cd43825aff3c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.157780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.159245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.159973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.160399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] PATH_INFO: `/v3/projects/b1b70b6b337b45fc89b2d84b32664c0b/users/5183b95ded584f0884e23dd15fcc5231/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.183454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b70b6b337b45fc89b2d84b32664c0b, user_id=5183b95ded584f0884e23dd15fcc5231, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.186812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3d347-3d50-4dd3-a158-8d1ce6241d55 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.217831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 944/1929] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:56 2022] PUT /identity/v3/projects/b1b70b6b337b45fc89b2d84b32664c0b/users/5183b95ded584f0884e23dd15fcc5231/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:56.219162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.219510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.219789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.221129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5ac5f54f7142b884667194eeb89518', 'request_id': 'req-c1406450-756e-461c-a210-f428930cffd3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.237449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5ac5f54f7142b884667194eeb89518', 'request_id': 'req-c1406450-756e-461c-a210-f428930cffd3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.249180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5ac5f54f7142b884667194eeb89518', 'request_id': 'req-c1406450-756e-461c-a210-f428930cffd3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.272194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] MFA Rules not processed for user `e5289ead5fe24f12a34bf75472b63df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:56.274248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.274631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] The token cache is being invalidate because project 3a5ac5f54f7142b884667194eeb89518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:56.275270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.277020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c1406450-756e-461c-a210-f428930cffd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.278945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 986/1930] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:56 2022] DELETE /identity/v3/projects/3a5ac5f54f7142b884667194eeb89518 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:56.282289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.282736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.283019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.319284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] MFA Rules not processed for user `5183b95ded584f0884e23dd15fcc5231`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:56.321061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.369585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 945/1931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:56.369585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.369585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.411168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:56.433588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 987/1932] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:56.434419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.438432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.451985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ceab0-74cf-4bef-a262-985f525828ed None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.458176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.458869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.459209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.459468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] PATH_INFO: `/v3/users/d12979fc917a42c7bba8de43e2368f52` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.460033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:56.462014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12979fc917a42c7bba8de43e2368f52)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.465477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.517908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12979fc917a42c7bba8de43e2368f52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.519310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120c1d9-f08c-47dd-9d8a-d2bb290f377a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.525664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.527339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.528008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.528404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.533106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12979fc917a42c7bba8de43e2368f52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.544030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12979fc917a42c7bba8de43e2368f52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.545490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12979fc917a42c7bba8de43e2368f52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.546224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12979fc917a42c7bba8de43e2368f52'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:56.547413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.549398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.561047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 988/1933] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:56.564607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.564737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 946/1934] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:56 2022] DELETE /identity/v3/users/d12979fc917a42c7bba8de43e2368f52 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:56.564833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.579230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bd484-31c5-46bb-bb1f-c39f626e3a95 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.673619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.674306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.674590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.674865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.675506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.678258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.745330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 989/1935] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:56 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:56.749526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.751197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:56.782059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef465a-721e-4ff4-bd23-b1c03a3c4458 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.920320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.921021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.921337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.921614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.922336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.925610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:56.967464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 947/1936] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:56 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:56.968743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:56.984375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c432c9-727f-43d2-afd9-3969771f7df3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:56.990658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:56.991830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:56.992819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:56.993199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:56.994125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:56.995989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.015205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 990/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:57.016737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.032689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5049a7-95b4-442a-b819-db113719acdf admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.043151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.043959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.044311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.045754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] PATH_INFO: `/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c/users/c697924992d5480c88bef8a91d53d174/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.079105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec003d70e46b4f17a66b9feb32b5d93c, user_id=c697924992d5480c88bef8a91d53d174, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.083948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.121908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.126183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 948/1938] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:57 2022] PUT /identity/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c/users/c697924992d5480c88bef8a91d53d174/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:11:57.129773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.150070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.196724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:57.200335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06645b5-d4dc-4a63-9598-40c294bd9ae0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.299490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba3b08-3207-4603-8ef8-4cf30ce2d1c4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.309762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.311604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.312786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.312945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.314436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.316429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.341682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 949/1939] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:57.343044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.355123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.355601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1b31-8c1a-40e2-94ba-2533580a7fa9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.357726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.358014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.358293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] PATH_INFO: `/v3/projects/4fe179a27bbe4df095d93eb6dbd67685` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.361022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.361958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.362316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.362795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] PATH_INFO: `/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c/users/c697924992d5480c88bef8a91d53d174/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.365062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec003d70e46b4f17a66b9feb32b5d93c, user_id=c697924992d5480c88bef8a91d53d174, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.368497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3489a-3412-4467-854d-b5bca4a14a99 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.368971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe179a27bbe4df095d93eb6dbd67685)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.371253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.391094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 950/1940] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:57 2022] PUT /identity/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c/users/c697924992d5480c88bef8a91d53d174/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:11:57.393490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7e2f-3ccb-4f2d-bca0-d875c9dd9013 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.393792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7e2f-3ccb-4f2d-bca0-d875c9dd9013 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.394077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7e2f-3ccb-4f2d-bca0-d875c9dd9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.434626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:57.454475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe179a27bbe4df095d93eb6dbd67685', 'request_id': 'req-84170dca-963e-40bc-9aaf-244f28557975'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:57.457679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a32b7e2f-3ccb-4f2d-bca0-d875c9dd9013 None None] MFA Rules not processed for user `c697924992d5480c88bef8a91d53d174`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:57.459727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a32b7e2f-3ccb-4f2d-bca0-d875c9dd9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.482875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe179a27bbe4df095d93eb6dbd67685', 'request_id': 'req-84170dca-963e-40bc-9aaf-244f28557975'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:57.505481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe179a27bbe4df095d93eb6dbd67685', 'request_id': 'req-84170dca-963e-40bc-9aaf-244f28557975'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:57.535760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] The token cache is being invalidate because project 4fe179a27bbe4df095d93eb6dbd67685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:11:57.536428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:57.537683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:57.540714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 991/1941] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:11:57 2022] DELETE /identity/v3/projects/4fe179a27bbe4df095d93eb6dbd67685 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:57.547269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.549715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.590875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 951/1942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:57.593089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.593585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.594016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.623289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:57.625432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.640104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170dca-963e-40bc-9aaf-244f28557975 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.645522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.646567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.646950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.647320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.649812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.719566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 952/1943] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:57.721128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.722833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.727529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.729096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47dde9-7ca3-40b6-a784-91dce7737580 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.737933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705cfb-8013-4e00-84f9-17859a419571 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.742236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.743163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.743452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.743866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.752797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 992/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:57.754947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.757621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.757844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.772210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.774312 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.791685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:57.793488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 953/1945] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:57.797892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:57.809259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 993/1946] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:57.812865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.819509 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:57.826909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db5e36-b707-49be-b3d4-f791ae5561a5 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.832558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.833566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.833566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.833780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.834456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:11:57.834760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.837118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.854866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 954/1947] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:11:57.860110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.872395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6b2f-a9b2-4cbb-8551-8511609d1955 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:57.877855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:57.878595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:57.878997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:57.879403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:57.880110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:57.882144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:57.921628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 994/1948] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:57 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:57.923234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:57.937309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f47b49-1803-45cc-a189-1061e8482558 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.018718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.019406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.019517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.019874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.019955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.020570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.022714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.064907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 955/1949] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:57 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:58.068736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.087335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a3f2c-f2b7-46f7-a1ce-a2edb58976a6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.089853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.090583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.091122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.091496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.092556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.094275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.110863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 956/1950] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:11:58.116285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.141486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e04c-3423-4c7c-9e1f-cceec43ad3d4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.141486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.141486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.141486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.142081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.142081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.143242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.153425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:58.160105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 957/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:58.161199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.164545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa191f-1fea-4783-ae24-b92c3b75ac52 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.170846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.171890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.172616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.173099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.175132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:58.181450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e47eff-ce72-413d-af33-c56a1ef87975 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.187588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.188387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.188673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.188949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] PATH_INFO: `/v3/projects/f7d734a96acf4a4d8fcc6047bb7de9d0/users/f339a0bd52104557bd6895d0a1bcc339/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.210434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d734a96acf4a4d8fcc6047bb7de9d0, user_id=f339a0bd52104557bd6895d0a1bcc339, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.214211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631682-ba13-4bdf-a3ab-73f902b8f4ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.236144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 958/1952] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:58 2022] PUT /identity/v3/projects/f7d734a96acf4a4d8fcc6047bb7de9d0/users/f339a0bd52104557bd6895d0a1bcc339/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:11:58.248941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.249630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.249978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.287388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.288905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.297728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] MFA Rules not processed for user `f339a0bd52104557bd6895d0a1bcc339`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:58.299480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:58.318102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 995/1953] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:58.414132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.414472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 959/1954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:11:58.440987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05e-4fdb-45ca-b61c-553124cf46aa service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.525147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.526409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.526874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.527811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.529161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.531323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.567278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 996/1955] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:11:58 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:11:58.571970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.583683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04bbf-570e-4363-8506-eb3e011cacc3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.634602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:58.695864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.696847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.697459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.698189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.699212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.701892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.778699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 960/1956] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:11:58 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:11:58.779800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.804470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b258f-d52f-4f5b-b977-7b1057b6755d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.823968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.824652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.824869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.825142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.825849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.827448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.854318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 997/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:58.855442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.869290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949f718-bb43-498d-9f30-f03a29b91e06 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:58.884430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:58.885477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:58.885477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:58.885657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] PATH_INFO: `/v3/projects/87819d14464a44c889f698141be9441b/users/0a0cc10929f341699176904e58baa077/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:58.925797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87819d14464a44c889f698141be9441b, user_id=0a0cc10929f341699176904e58baa077, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:58.928553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:58.950815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 961/1958] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:58 2022] PUT /identity/v3/projects/87819d14464a44c889f698141be9441b/users/0a0cc10929f341699176904e58baa077/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:11:58.955095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:58.979689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef7658-26e4-4bb6-a63e-f127cb3a4693 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:59.073829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:59.074526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.074750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.074994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.075644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:59.077303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff58d1-9e96-41e6-92ff-9173ed87e544 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:59.089305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 998/1959] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:11:59.094316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:59.105084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58afa5-4943-45cd-a95b-c18e8f285d87 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:59.110249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:59.110989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.111374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.111721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] PATH_INFO: `/v3/projects/87819d14464a44c889f698141be9441b/users/0a0cc10929f341699176904e58baa077/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.114689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=87819d14464a44c889f698141be9441b, user_id=0a0cc10929f341699176904e58baa077, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:59.116590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:59.138140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 962/1960] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:11:59 2022] PUT /identity/v3/projects/87819d14464a44c889f698141be9441b/users/0a0cc10929f341699176904e58baa077/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:59.147665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.148504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.148788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.179900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:11:59.183090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] MFA Rules not processed for user `0a0cc10929f341699176904e58baa077`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:59.184716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:59.388837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 999/1961] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:11:59.407050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:59.478792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d9e-ab84-42f6-9075-de4316dbcdce admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:59.485718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:59.486621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.487039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.487407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.501445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:59.503405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e9eeb-ec17-4089-bb67-43223466e83d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:59.520449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 963/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:11:59.686596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:11:59.772512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5146f6f-38f3-4c68-9616-698f5f02868f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:11:59.777687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:11:59.778533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.778819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.779089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] PATH_INFO: `/v3/users/f339a0bd52104557bd6895d0a1bcc339` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.780415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f339a0bd52104557bd6895d0a1bcc339)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:11:59.788124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:11:59.842746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f339a0bd52104557bd6895d0a1bcc339'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:59.856890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f339a0bd52104557bd6895d0a1bcc339'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:59.857773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f339a0bd52104557bd6895d0a1bcc339'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:59.878897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f339a0bd52104557bd6895d0a1bcc339'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:59.879615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f339a0bd52104557bd6895d0a1bcc339'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:11:59.894331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1000/1963] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:11:59 2022] DELETE /identity/v3/users/f339a0bd52104557bd6895d0a1bcc339 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:11:59.899134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:11:59.899497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:11:59.899871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:11:59.921022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:11:59.922280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:11:59.994074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 964/1964] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:00.001578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:00.003837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.033072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:00.074828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd990fb9-d305-4930-ba67-37f5063c0d70 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:00.080209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:00.081088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.081346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.082048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.093576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:00.096225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52b01-ea21-47c2-bafe-902bf1178a7d service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:00.097790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:00.099620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.114137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1001/1965] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:00.118867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f863da8-c328-450d-abb6-7a707350a8fc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:00.127087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:00.128155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.128933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.129264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] PATH_INFO: `/v3/users/e5289ead5fe24f12a34bf75472b63df1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.130701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5289ead5fe24f12a34bf75472b63df1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:00.134511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:00.156502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:00.244692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5289ead5fe24f12a34bf75472b63df1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.274651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5289ead5fe24f12a34bf75472b63df1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.291782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5289ead5fe24f12a34bf75472b63df1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.293433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5289ead5fe24f12a34bf75472b63df1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.294631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5289ead5fe24f12a34bf75472b63df1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.342555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.342555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.342555 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.345119 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 965/1966] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:00 2022] DELETE /identity/v3/users/e5289ead5fe24f12a34bf75472b63df1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:00.363017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:00.364790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.520147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1002/1967] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:00.540692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:00.542608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.561302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:00.563058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.591168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21cea9-4d6c-4a63-9a55-e57b2459caf1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:00.603316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:00.603979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.604363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.604523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] PATH_INFO: `/v3/projects/f7d734a96acf4a4d8fcc6047bb7de9d0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.606044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d734a96acf4a4d8fcc6047bb7de9d0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:00.607897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:00.721699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251dee1-f2df-4d27-8c60-6bc17ab18cec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:00.746996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d734a96acf4a4d8fcc6047bb7de9d0', 'request_id': 'req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.756749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d734a96acf4a4d8fcc6047bb7de9d0', 'request_id': 'req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.767000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d734a96acf4a4d8fcc6047bb7de9d0', 'request_id': 'req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.786814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] The token cache is being invalidate because project f7d734a96acf4a4d8fcc6047bb7de9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:00.787161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.787785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:00.792582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1003/1968] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:00 2022] DELETE /identity/v3/projects/f7d734a96acf4a4d8fcc6047bb7de9d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:00.793648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:00.795338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.820556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:00.821492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.822138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.822527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.825321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:00.857812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:00.892395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d2501-d9c4-4d8d-aa09-1e9723f9b601 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:00.917503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:00.918336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:00.918654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:00.919273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] PATH_INFO: `/v3/users/0a0cc10929f341699176904e58baa077` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:00.923383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0cc10929f341699176904e58baa077)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:00.927568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:00.953924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:00.955790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:00.960909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:00.977477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 966/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:01.021797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0cc10929f341699176904e58baa077'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.039389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0cc10929f341699176904e58baa077'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.041013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0cc10929f341699176904e58baa077'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.054955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0cc10929f341699176904e58baa077'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.056477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0cc10929f341699176904e58baa077'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.081276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1004/1970] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:00 2022] DELETE /identity/v3/users/0a0cc10929f341699176904e58baa077 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:01.430162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:01.431803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:01.452723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd76ae-5d65-433e-9d89-0ab432036308 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:01.533833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:01.536420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:01.567281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:01.567947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:01.568234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:01.568613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] PATH_INFO: `/v3/projects/4cb747a7cd814aa6add3dffd99e86e0c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:01.569751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb747a7cd814aa6add3dffd99e86e0c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:01.571705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:01.676161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb747a7cd814aa6add3dffd99e86e0c', 'request_id': 'req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.684853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04d4f7-3fd2-47b6-baff-0e2a1347995f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:01.694102 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb747a7cd814aa6add3dffd99e86e0c', 'request_id': 'req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.702707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb747a7cd814aa6add3dffd99e86e0c', 'request_id': 'req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.728208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] The token cache is being invalidate because project 4cb747a7cd814aa6add3dffd99e86e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:01.728439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.729105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ddfc2f0e-e321-41a0-b8ed-b5aa605bd397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.732534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 967/1971] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:01 2022] DELETE /identity/v3/projects/4cb747a7cd814aa6add3dffd99e86e0c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:01.737415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80019-a2eb-4b93-8619-6364dcf9949d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:01.737712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80019-a2eb-4b93-8619-6364dcf9949d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:01.738050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80019-a2eb-4b93-8619-6364dcf9949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:01.805093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-83a80019-a2eb-4b93-8619-6364dcf9949d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:01.806467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-83a80019-a2eb-4b93-8619-6364dcf9949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:01.839138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:01.840151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:01.841418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:01.842084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] PATH_INFO: `/v3/projects/87819d14464a44c889f698141be9441b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:01.849520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87819d14464a44c889f698141be9441b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:01.852553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:01.872960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:01.965801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87819d14464a44c889f698141be9441b', 'request_id': 'req-01912ec0-8a20-424a-87c2-562552f9d85b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.972764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87819d14464a44c889f698141be9441b', 'request_id': 'req-01912ec0-8a20-424a-87c2-562552f9d85b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.977620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 968/1972] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:01.982805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87819d14464a44c889f698141be9441b', 'request_id': 'req-01912ec0-8a20-424a-87c2-562552f9d85b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:01.983645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5426-325d-48f1-a906-0651db97d16c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:01.984131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5426-325d-48f1-a906-0651db97d16c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:01.984612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5426-325d-48f1-a906-0651db97d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.010181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] The token cache is being invalidate because project 87819d14464a44c889f698141be9441b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:02.010500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:02.013521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-01912ec0-8a20-424a-87c2-562552f9d85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:02.016176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1005/1973] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:01 2022] DELETE /identity/v3/projects/87819d14464a44c889f698141be9441b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:02.021682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb715c9-8bec-4161-86bb-4215db434d04 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.021972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb715c9-8bec-4161-86bb-4215db434d04 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.022300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb715c9-8bec-4161-86bb-4215db434d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.040761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-358b5426-325d-48f1-a906-0651db97d16c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:02.042181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-358b5426-325d-48f1-a906-0651db97d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:02.099615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9bb715c9-8bec-4161-86bb-4215db434d04 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:02.100911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9bb715c9-8bec-4161-86bb-4215db434d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:02.103791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:02.222816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 969/1974] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:02.235322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5426-325d-48f1-a906-0651db97d16c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.257621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5426-325d-48f1-a906-0651db97d16c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.264933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1006/1975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:02.271707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.272465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.273437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.273816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.274209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb884-2376-41fb-830b-79e025139b76 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.274502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb884-2376-41fb-830b-79e025139b76 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.274783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb884-2376-41fb-830b-79e025139b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.274888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:02.275310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.277292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.307202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0affb884-2376-41fb-830b-79e025139b76 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:02.309090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0affb884-2376-41fb-830b-79e025139b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:02.320206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1007/1976] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:02.324766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 970/1977] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:02.329168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb884-2376-41fb-830b-79e025139b76 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.330651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.341941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb884-2376-41fb-830b-79e025139b76 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.350778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.352083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.352379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.352638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.353397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:02.353876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.354419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810be0f-ed33-4c76-8b25-246fee62dfd1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.365461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.366085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.366867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.366867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.367836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.370584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.371615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.417270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1008/1978] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:02.433763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.462680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 971/1979] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:02.467032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.503411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1305f-052f-4199-a088-fec1ba0a665d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.601543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468b5e-e043-4adc-937b-e2c9298e02e8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.606739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.607315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.607603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.608170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.608673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.611156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.644958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 972/1980] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:02.646741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.665559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485aaf-6b05-4236-a37f-ddb343f37143 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.675516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.677979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.682267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.682519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.683091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.684761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.697056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.697758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.698062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.698330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.698917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.700996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.705559 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 973/1981] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:02.706795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.718786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51578df-e5bc-455e-aab5-a599e7df56de admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.729038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.729745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.730769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.730769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.731208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.733494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.749362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 974/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:02.752784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.753390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1009/1983] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:02.757635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.779459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:02.787426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe30483-2d32-4681-b9c4-172e98467cf1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.884035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a870eb-e517-4720-aab1-234989dd7bd1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:02.889695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.890683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.891107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.891606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.892247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.894236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.899432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:02.900135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:02.900440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:02.900842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] PATH_INFO: `/v3/projects/eca1d4d450eb40a3b1fecbb69e096158/users/fee1f033a0274fa3a823c639180c741a/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:02.904652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:02.919985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca1d4d450eb40a3b1fecbb69e096158, user_id=fee1f033a0274fa3a823c639180c741a, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:02.924088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1010/1984] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:02 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:02.924088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:02.924088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:02.924825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:02.944731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 975/1985] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:02 2022] PUT /identity/v3/projects/eca1d4d450eb40a3b1fecbb69e096158/users/fee1f033a0274fa3a823c639180c741a/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:02.949443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.040931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec1abb-28ce-4033-8f69-edb2bfa4b138 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.048942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.049441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112807b-9f37-4ec9-ad17-aa8ca56590bc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.050129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.051271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.052054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.052856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.056021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d169031-23e5-4d82-bb3a-12696ebfd094 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.084700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 976/1986] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:03.084700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.084700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.084700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.129161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] MFA Rules not processed for user `fee1f033a0274fa3a823c639180c741a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:03.132047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:03.136147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.137745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.138129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.138502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.140577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:03.225399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 977/1987] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:03.225738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.226181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.227320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.245796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1011/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:03.246999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.249699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:03.250618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afa13-8fab-4208-8c0e-6e66ad84a914 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.258612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.259377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.259542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.260039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.260864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.263031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:03.263538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.281595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 978/1989] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:03.285812 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.297342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5e333-1215-4aaf-84aa-e67a4f211eae admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.303956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.304333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.304771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.305060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] PATH_INFO: `/v3/projects/1ff340ca43524cfdabbc2128feaa8936/users/28d241111e27464ca39ac43d132b5509/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.323924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff340ca43524cfdabbc2128feaa8936, user_id=28d241111e27464ca39ac43d132b5509, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.327029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44a54-d338-4b73-90f1-6fa8fe5fe7d7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.357208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 979/1990] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:03 2022] PUT /identity/v3/projects/1ff340ca43524cfdabbc2128feaa8936/users/28d241111e27464ca39ac43d132b5509/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:03.358801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.359636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.359636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.380632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76cd22-ffc8-441c-b9dc-59ae9e647de1 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.391032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] MFA Rules not processed for user `28d241111e27464ca39ac43d132b5509`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:03.392316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:03.431467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:03.462025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.464511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.465355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.465649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.494079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 980/1991] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:03.498195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.563400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.566188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.582491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1012/1992] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:03.582660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c544-796b-4aef-8c56-85ca5ba755d6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.592819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.593476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.593759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.594033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.594713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.596729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.629841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 981/1993] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:03.634578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.646838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004c664-6e42-45ef-a960-6a6e23041dc4 service glance] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.707860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:03.720843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.721680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.721945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.722282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.722844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.724764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.753207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1013/1994] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:03 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:03.757986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.771941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12803a6-e17b-402d-a458-460474c23780 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.779785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.780601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.780752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.781500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.783202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.785108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.801266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 982/1995] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:03.805816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.817068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac4c3-6760-430d-93a4-e93bd457a652 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.823078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.823750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.824035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.824312 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] PATH_INFO: `/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d/users/fad794afa2b149a4a667b4e688233052/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.841216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23df9f6e2c524783b7f72812f6d0fd4d, user_id=fad794afa2b149a4a667b4e688233052, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.844640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.864210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1014/1996] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:03 2022] PUT /identity/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d/users/fad794afa2b149a4a667b4e688233052/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:03.865256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:03.877780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12edea5-a509-47e5-b2e0-9422b119d39d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:03.958536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:03.959396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:03.959761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:03.960125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:03.962058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:03.965101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bba87f-2648-4666-b91f-dc6f60a51ecc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:03.983329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 983/1997] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:03.987325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:04.000179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db72eab-d62b-4f84-8b2d-b8261978711f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:04.005912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:04.006837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:04.008044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:04.008540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] PATH_INFO: `/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d/users/fad794afa2b149a4a667b4e688233052/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:04.012929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23df9f6e2c524783b7f72812f6d0fd4d, user_id=fad794afa2b149a4a667b4e688233052, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:04.016354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:04.041010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1015/1998] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:03 2022] PUT /identity/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d/users/fad794afa2b149a4a667b4e688233052/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:04.044762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:04.045056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:04.045425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:04.087519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] MFA Rules not processed for user `fad794afa2b149a4a667b4e688233052`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:04.088815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:04.125545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:04.199997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 984/1999] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:04.221989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:04.297578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f196-26ba-4de2-9d74-00869727c7c8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:04.304986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:04.305655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:04.306004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:04.306747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:04.317471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:04.319390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:04.334945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1016/2000] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:04.424035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:04.433415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a3274-e164-4edb-a5a3-e6f495458db6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:04.436923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:04.437565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:04.437849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:04.438133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:04.499820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:04.501469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28c6cb-0a53-4741-9ee0-c77138867c5f service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:04.512452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 985/2001] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:05.503390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:05.504850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:05.578035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064099-8dd9-4b56-9149-2b6d62839942 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:05.583363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:05.584127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:05.584393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:05.584674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] PATH_INFO: `/v3/users/5183b95ded584f0884e23dd15fcc5231` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:05.586151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5183b95ded584f0884e23dd15fcc5231)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:05.588414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:05.642590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5183b95ded584f0884e23dd15fcc5231'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:05.648967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:05.658187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5183b95ded584f0884e23dd15fcc5231'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:05.659041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5183b95ded584f0884e23dd15fcc5231'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:05.667767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5183b95ded584f0884e23dd15fcc5231'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:05.668712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5183b95ded584f0884e23dd15fcc5231'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:05.684198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1017/2002] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:05 2022] DELETE /identity/v3/users/5183b95ded584f0884e23dd15fcc5231 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:05.688751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:05.689294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:05.689388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:05.710458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:05.711760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:05.781642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 986/2003] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:05.793353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:05.795343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:05.870196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd79a-2c96-424e-bf6d-819485fb9d15 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:05.873847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:05.874465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:05.874744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:05.875015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:05.884571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:05.886109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef299dbe-56ff-4d0b-a746-23c6e3deef0a service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:05.896453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1018/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:05.909319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:05.910938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:05.924228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7759a-b19e-4a62-8719-4b4396a271c7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:05.939495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:05.940422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:05.940912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:05.941432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] PATH_INFO: `/v3/users/10cec534c36842a68f17fc5aa7e09543` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:05.943024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cec534c36842a68f17fc5aa7e09543)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:05.945438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:06.040977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cec534c36842a68f17fc5aa7e09543'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.049404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:06.078721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cec534c36842a68f17fc5aa7e09543'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.092234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cec534c36842a68f17fc5aa7e09543'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.093049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cec534c36842a68f17fc5aa7e09543'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.094172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cec534c36842a68f17fc5aa7e09543'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.140693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 987/2005] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:05 2022] DELETE /identity/v3/users/10cec534c36842a68f17fc5aa7e09543 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:06.145163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:06.145491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:06.146203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:06.167403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:06.169134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:06.248355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1019/2006] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:06.265790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:06.267729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:06.290567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:06.292250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:06.312655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6f4f6-52ab-47a1-9fff-40f701b95cb9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:06.336036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:06.337095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:06.338085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:06.338690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] PATH_INFO: `/v3/projects/b1b70b6b337b45fc89b2d84b32664c0b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:06.342740 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b70b6b337b45fc89b2d84b32664c0b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:06.345069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:06.415329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1a51-8282-4e29-8f00-5b1fd6d5da83 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:06.422668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:06.424085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:06.426086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:06.426379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:06.461016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:06.463737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:06.478626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b70b6b337b45fc89b2d84b32664c0b', 'request_id': 'req-1179498a-38b4-41a4-bf59-b0dc6009a7ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.488822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 988/2007] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:06.499423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b70b6b337b45fc89b2d84b32664c0b', 'request_id': 'req-1179498a-38b4-41a4-bf59-b0dc6009a7ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.509900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b70b6b337b45fc89b2d84b32664c0b', 'request_id': 'req-1179498a-38b4-41a4-bf59-b0dc6009a7ac'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.526451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:06.542135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] The token cache is being invalidate because project b1b70b6b337b45fc89b2d84b32664c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:06.543009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.545795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.548316 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1020/2008] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:06 2022] DELETE /identity/v3/projects/b1b70b6b337b45fc89b2d84b32664c0b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:06.552528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:06.574020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e5da4-65ad-4dd4-afe8-ae5d418f080c service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:06.649721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:06.650471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:06.650833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:06.651233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] PATH_INFO: `/v3/users/c697924992d5480c88bef8a91d53d174` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:06.652511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c697924992d5480c88bef8a91d53d174)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:06.654735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:06.717329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c697924992d5480c88bef8a91d53d174'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.733829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c697924992d5480c88bef8a91d53d174'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.743521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c697924992d5480c88bef8a91d53d174'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.744759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c697924992d5480c88bef8a91d53d174'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.745022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c697924992d5480c88bef8a91d53d174'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:06.750016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:06.771171 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 989/2009] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:06 2022] DELETE /identity/v3/users/c697924992d5480c88bef8a91d53d174 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:06.852764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:06.854319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:06.872025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179498a-38b4-41a4-bf59-b0dc6009a7ac admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:06.932894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:06.933595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:06.933871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:06.934150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] PATH_INFO: `/v3/projects/41cd4c4b2c0e435980782fafafb8d402` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:06.935323 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41cd4c4b2c0e435980782fafafb8d402)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:06.937294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:06.993809 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41cd4c4b2c0e435980782fafafb8d402', 'request_id': 'req-c109055a-b878-42d3-adf2-8014b622e897'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.002921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41cd4c4b2c0e435980782fafafb8d402', 'request_id': 'req-c109055a-b878-42d3-adf2-8014b622e897'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.011053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41cd4c4b2c0e435980782fafafb8d402', 'request_id': 'req-c109055a-b878-42d3-adf2-8014b622e897'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.026310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] The token cache is being invalidate because project 41cd4c4b2c0e435980782fafafb8d402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:07.026605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.027287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.028808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1021/2010] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:06 2022] DELETE /identity/v3/projects/41cd4c4b2c0e435980782fafafb8d402 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:07.033063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:07.035638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:07.052802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fc271-5615-4ef9-a5c5-e682caa7fb28 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:07.115683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:07.116327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.116608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.116888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] PATH_INFO: `/v3/users/370682e0a83a4ab8a18415c9fbe72752` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.118331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370682e0a83a4ab8a18415c9fbe72752)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:07.120298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:07.191215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370682e0a83a4ab8a18415c9fbe72752'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.204831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370682e0a83a4ab8a18415c9fbe72752'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.219310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370682e0a83a4ab8a18415c9fbe72752'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.219944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370682e0a83a4ab8a18415c9fbe72752'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.220566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-86957cfa-7c3b-42b5-82e7-8dbe85a53be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370682e0a83a4ab8a18415c9fbe72752'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.235726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 990/2011] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:07 2022] DELETE /identity/v3/users/370682e0a83a4ab8a18415c9fbe72752 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:07.332483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:07.334300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:07.351157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109055a-b878-42d3-adf2-8014b622e897 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:07.432602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:07.432782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.432946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.433236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] PATH_INFO: `/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.442946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec003d70e46b4f17a66b9feb32b5d93c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:07.445812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:07.497666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:07.516694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec003d70e46b4f17a66b9feb32b5d93c', 'request_id': 'req-31dcedae-bc70-4543-a7a6-59f916b302ed'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.530704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec003d70e46b4f17a66b9feb32b5d93c', 'request_id': 'req-31dcedae-bc70-4543-a7a6-59f916b302ed'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.558637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec003d70e46b4f17a66b9feb32b5d93c', 'request_id': 'req-31dcedae-bc70-4543-a7a6-59f916b302ed'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.588103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] The token cache is being invalidate because project ec003d70e46b4f17a66b9feb32b5d93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:07.588914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.590864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:07.595034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1022/2012] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:07 2022] DELETE /identity/v3/projects/ec003d70e46b4f17a66b9feb32b5d93c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:07.599835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49590d5-03cc-413d-a9ac-7d90f81c0c01 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.600120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49590d5-03cc-413d-a9ac-7d90f81c0c01 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.601492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49590d5-03cc-413d-a9ac-7d90f81c0c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.650814 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f49590d5-03cc-413d-a9ac-7d90f81c0c01 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:07.652477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f49590d5-03cc-413d-a9ac-7d90f81c0c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:07.800867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:07.803113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:07.827113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 991/2013] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:07.836818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.839089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.839490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.899226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:07.901384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:07.924781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 992/2014] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:07.932797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:07.956377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcedae-bc70-4543-a7a6-59f916b302ed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:07.956732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:07.957120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.957450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.957724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] PATH_INFO: `/v3/projects/c4bc20c2b70843a2b63a9792fef34863` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.959162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bc20c2b70843a2b63a9792fef34863)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:07.959611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff3a7-1ca5-4617-9735-64d6855563be None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:07.962547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:07.965169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:07.966004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:07.966283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:07.966672 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:07.967456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:07.968593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:07.973990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:07.977126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:08.004251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 993/2015] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:12:08.008873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.050406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd909-b4ee-4eb1-861d-324c341fc0ef admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.067478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.068624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.069154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.070588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.071728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.077763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.103772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bc20c2b70843a2b63a9792fef34863', 'request_id': 'req-e9b998fa-d18e-45a4-84ed-8b4d512fa740'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.115040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bc20c2b70843a2b63a9792fef34863', 'request_id': 'req-e9b998fa-d18e-45a4-84ed-8b4d512fa740'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.136439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 994/2016] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:08 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:08.136643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bc20c2b70843a2b63a9792fef34863', 'request_id': 'req-e9b998fa-d18e-45a4-84ed-8b4d512fa740'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.138504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.205798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] The token cache is being invalidate because project c4bc20c2b70843a2b63a9792fef34863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:08.206098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.211481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.221684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1023/2017] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:07 2022] DELETE /identity/v3/projects/c4bc20c2b70843a2b63a9792fef34863 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:08.227519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.232497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:08.318634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec008bb-cd43-4254-8d89-e7e20323fb88 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.331403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.331922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.332203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.332477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.333113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.335701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.335823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:08.362518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b998fa-d18e-45a4-84ed-8b4d512fa740 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.374910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.376550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.377591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.378929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] PATH_INFO: `/v3/users/2132e6afe1e64ef7b9c43ad7d6448fc1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.379946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 995/2018] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:08 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:08.381027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2132e6afe1e64ef7b9c43ad7d6448fc1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.383306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.384445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.386686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:08.400915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803668a2-c2b4-4081-a3f4-851122eeb4ea admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.406816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.407667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.408131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.408682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.409681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.411635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.424600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 996/2019] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:08.428624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.444224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b606b14-6829-4b32-be0e-931b18d1e133 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.454561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2132e6afe1e64ef7b9c43ad7d6448fc1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.461478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.462434 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.462730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.463123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.463787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.465452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.481917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 997/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:08.487888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.494004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2132e6afe1e64ef7b9c43ad7d6448fc1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.494937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2132e6afe1e64ef7b9c43ad7d6448fc1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.502542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c189a3-af10-4821-b679-6ada4e59e399 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.508803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.509524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.509807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.510115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] PATH_INFO: `/v3/projects/22425229f822435897f140f9161c9d7f/users/b7f4b6124680447b82f9fc309d5b7dbe/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.512559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2132e6afe1e64ef7b9c43ad7d6448fc1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.514610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-4b360ff5-5acd-4161-8d9c-b5acfd6e0f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2132e6afe1e64ef7b9c43ad7d6448fc1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:08.535975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1024/2021] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:08 2022] DELETE /identity/v3/users/2132e6afe1e64ef7b9c43ad7d6448fc1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:08.540886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22425229f822435897f140f9161c9d7f, user_id=b7f4b6124680447b82f9fc309d5b7dbe, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.544105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.562035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 998/2022] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:08 2022] PUT /identity/v3/projects/22425229f822435897f140f9161c9d7f/users/b7f4b6124680447b82f9fc309d5b7dbe/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:08.573987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.574177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.574443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.618419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] MFA Rules not processed for user `b7f4b6124680447b82f9fc309d5b7dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:08.619877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:08.724129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1025/2023] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:08.731006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.736437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:08.849332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff317f5d-0b98-4453-91b5-dc2a1a0f86a8 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.865662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:08.866639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:08.867066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:08.867700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:08.868480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:08.871004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:08.897432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:08.912454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 999/2024] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:08 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:08.917274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.928395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccf178-3728-40bb-ab18-befb28554e20 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:08.930062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:08.931962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.003396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:09.029437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.029437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.029437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.029437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.029779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.029779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.037305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59691a3-774e-4394-b684-c7b6c91e1749 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.043846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.044656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.045044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.045527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] PATH_INFO: `/v3/projects/e3bc8f9389394d6b84655ce4541adf36` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.046820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bc8f9389394d6b84655ce4541adf36)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.048901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.050220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1026/2025] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:08 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:09.055190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.073845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3226-25de-4397-82a5-d2e132dd75f3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.079540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.080280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.080564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.081013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.097608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.099291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.121106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bc8f9389394d6b84655ce4541adf36', 'request_id': 'req-2d854e90-aa53-4df0-b1e6-a331887d5665'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:09.124856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1027/2026] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:09.126712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.138590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bc8f9389394d6b84655ce4541adf36', 'request_id': 'req-2d854e90-aa53-4df0-b1e6-a331887d5665'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:09.148681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ed67-b539-4a62-938c-f483d088954d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.149301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bc8f9389394d6b84655ce4541adf36', 'request_id': 'req-2d854e90-aa53-4df0-b1e6-a331887d5665'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:09.173610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] The token cache is being invalidate because project e3bc8f9389394d6b84655ce4541adf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:09.174069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:09.174857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2d854e90-aa53-4df0-b1e6-a331887d5665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:09.178154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1000/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:08 2022] DELETE /identity/v3/projects/e3bc8f9389394d6b84655ce4541adf36 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:09.183721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-5650-4572-a08b-3e28321d0dab None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.184303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-5650-4572-a08b-3e28321d0dab None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.184728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-5650-4572-a08b-3e28321d0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.242832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-74799fbc-5650-4572-a08b-3e28321d0dab None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:09.246517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74799fbc-5650-4572-a08b-3e28321d0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.290205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.290943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.291373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.291707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] PATH_INFO: `/v3/projects/21cbd2e8983d41b6bdce8982ed700b43/users/197910f385e14a13986253224abc6708/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.334075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cbd2e8983d41b6bdce8982ed700b43, user_id=197910f385e14a13986253224abc6708, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.338483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.371697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1028/2028] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:09 2022] PUT /identity/v3/projects/21cbd2e8983d41b6bdce8982ed700b43/users/197910f385e14a13986253224abc6708/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:09.373047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.375220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.385089 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1001/2029] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:09.395538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.396173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.396743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.422377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:09.423627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.452255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:09.471366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db8552-f366-4ff5-9b24-4fefc5ef717e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.477311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.478057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.478298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.478578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.479223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.480842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.491894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1029/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:09.494859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1002/2031] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:09.496795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.499071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.508403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde3ff5-bfcd-4528-b1da-2adc252b8702 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.509248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841f34-e52c-4bc8-981b-15e39e73885d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.513472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.514140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.514375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.514485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.514731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] PATH_INFO: `/v3/projects/21cbd2e8983d41b6bdce8982ed700b43/users/197910f385e14a13986253224abc6708/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.515058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.515354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.515893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.516317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:09.516725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.517559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cbd2e8983d41b6bdce8982ed700b43, user_id=197910f385e14a13986253224abc6708, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.518533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1c2b5-2055-48d6-a4a5-5677b31287c4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.520689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.544653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1030/2032] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:09 2022] PUT /identity/v3/projects/21cbd2e8983d41b6bdce8982ed700b43/users/197910f385e14a13986253224abc6708/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:09.545460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1003/2033] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:12:09.545561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.546416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.546768 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.547048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.583865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] MFA Rules not processed for user `197910f385e14a13986253224abc6708`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:09.586052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.605977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:09.632349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a100-382c-4613-8923-cdd86807abb5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.639489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.640208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.641169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.641629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.643138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.646386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.679575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1031/2034] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:09.682795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.683601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1004/2035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:09.695084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.696691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.759130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9b74d-b36e-4fb1-90f4-d50b41683c31 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.764176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.764795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.765085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.765397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.766039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.767986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.775277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e30b-2e4d-41ad-a50e-6b41e3717c39 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.800324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1032/2036] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:09.801502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.812832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f252-e7e4-4b4a-bafb-5cdfa3c0cae1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.819569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.820193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.820480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.820759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.821457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.823110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.837726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1033/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:09.842187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.849569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.850386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.851322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.851715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.854435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:09.862535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cbcf-1ce9-408f-b2fa-78306a5f708a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.868907 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.870696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.870911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:09.871033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.871033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.871033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.872521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.887410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1034/2038] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:09.888745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:09.901000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031354-e63f-4244-af27-342fd5da8eb2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:09.910838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:09.911636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.912150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.912437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] PATH_INFO: `/v3/projects/e18b7724e74b426e9d786843b5ce7c6c/users/dd4b61a87f8e4fd084546e3ee2db47f1/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.931462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.932125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18b7724e74b426e9d786843b5ce7c6c, user_id=dd4b61a87f8e4fd084546e3ee2db47f1, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:09.932911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813136f5-73c7-48c8-bf50-f55e28d86c55 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.934849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:09.942831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1005/2039] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:09.957748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1035/2040] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:09 2022] PUT /identity/v3/projects/e18b7724e74b426e9d786843b5ce7c6c/users/dd4b61a87f8e4fd084546e3ee2db47f1/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:09.963129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:09.963428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:09.963778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:09.995351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] MFA Rules not processed for user `dd4b61a87f8e4fd084546e3ee2db47f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:09.996542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:10.093147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1006/2041] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:10.094009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.161290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92138995-33b8-4f5b-ba9c-a5f8b4f54208 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.166706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.167315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.167598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.167874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.168516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.170849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.188483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:10.206038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1036/2042] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:10.207205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.220774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc249b4e-ca73-4d1c-a0f9-0958aaeefaf8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.306696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.307003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.307104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.307363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.308018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.310003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.340803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1007/2043] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:10.341770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.359981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2a025-3144-424b-b623-89088c663b22 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.368298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.368298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.368298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.368634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.369644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.371803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.387262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1037/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:10.391106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.404917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8023649-35de-45da-8593-1b0ada7c2145 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.417214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.418019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.418310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.418601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.419260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.421165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457d94-2c6e-45a7-8b7f-bede4bfa1d48 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.433687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1008/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:10.438006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.451082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b1df-019a-47e7-a1fb-f6f202124501 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.457331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.458221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.458577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.458922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] PATH_INFO: `/v3/projects/d35719eb6d284d7e8dfaae0076716271/users/c997daca3f114a53848e247eed3965fb/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.490635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35719eb6d284d7e8dfaae0076716271, user_id=c997daca3f114a53848e247eed3965fb, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.494872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.517315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1038/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:10 2022] PUT /identity/v3/projects/d35719eb6d284d7e8dfaae0076716271/users/c997daca3f114a53848e247eed3965fb/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:10.525422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.525901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.526301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.571896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] MFA Rules not processed for user `c997daca3f114a53848e247eed3965fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:10.573376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:10.583826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:10.652950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1009/2047] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:10.657199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.659588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:10.659707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.741977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92de07-f50f-4231-a317-8513c1986090 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.746518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037589-6d10-468e-ae59-555ec3913a99 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.748778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.749458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.749766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.750037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.750728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.752731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.753607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.754981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.755839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.756119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] PATH_INFO: `/v3/users/28d241111e27464ca39ac43d132b5509` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.757898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d241111e27464ca39ac43d132b5509)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.760195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.801795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1010/2048] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:10.807213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.844241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d241111e27464ca39ac43d132b5509'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:10.857784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d241111e27464ca39ac43d132b5509'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:10.858505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d241111e27464ca39ac43d132b5509'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:10.867835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d241111e27464ca39ac43d132b5509'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:10.868474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-202d11dc-5150-4b4d-a251-78dd525b626d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d241111e27464ca39ac43d132b5509'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:10.881519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1039/2049] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:10 2022] DELETE /identity/v3/users/28d241111e27464ca39ac43d132b5509 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:10.885810 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.886110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.886391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.887340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defdf9e-6251-47ed-abaa-ed552ccf6986 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:10.905116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:10.906277 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:10.932955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:10.946211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:10.950951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:10.951566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:10.951848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:10.952117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:10.952918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:10.955118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:10.977023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1040/2050] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:10.982907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1011/2051] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:10 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:10.986895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.989916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:10.990348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:10.992752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:11.007559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfd82-3d98-4b38-9ad3-ed0c2f699fb6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.013049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.013859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.013978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.014251 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.014895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.017275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.030971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1041/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:11.037793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.050143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5438c-93e6-4b2d-adaf-77a93388ec24 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.057356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.058020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.058302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.058578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] PATH_INFO: `/v3/projects/2bb787a59d3b46b29a599ee7c0832f70/users/d2a7865fd48e4e9283eaa178f87b8caf/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.065091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77742367-2156-4b36-90eb-b79647720402 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.074046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.074950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.075519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.077739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.080527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb787a59d3b46b29a599ee7c0832f70, user_id=d2a7865fd48e4e9283eaa178f87b8caf, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.083408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.088657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.090359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.105303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1042/2053] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:11 2022] PUT /identity/v3/projects/2bb787a59d3b46b29a599ee7c0832f70/users/d2a7865fd48e4e9283eaa178f87b8caf/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:11.110314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1012/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:11.110613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.212657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57617c45-996f-435e-a70c-bdf865f97da2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.218209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.218824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.219108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.219384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.220035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.221739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016da71-d34d-4526-9ddb-6cbe2a745d6e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.234348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1043/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:11.239210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.250634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395276a9-ee43-4162-b05c-ea80c63ca8ef service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.257608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.258624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.258911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.259231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] PATH_INFO: `/v3/projects/2bb787a59d3b46b29a599ee7c0832f70/users/d2a7865fd48e4e9283eaa178f87b8caf/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.261576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb787a59d3b46b29a599ee7c0832f70, user_id=d2a7865fd48e4e9283eaa178f87b8caf, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.264449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.277836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1013/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:11 2022] PUT /identity/v3/projects/2bb787a59d3b46b29a599ee7c0832f70/users/d2a7865fd48e4e9283eaa178f87b8caf/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:11.289750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.290041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.290319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.329244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] MFA Rules not processed for user `d2a7865fd48e4e9283eaa178f87b8caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:11.330472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:11.424441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1044/2057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:11.437753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.440222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:11.461278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.462724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:11.519278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:11.539922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ace44-9629-435d-b2d7-c359f7b73429 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.543990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.544964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.545267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.545552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.547354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:11.562285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5381e82-a68c-4d6b-b1c0-810ddfb3a061 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.567244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.567994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.568348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.568699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] PATH_INFO: `/v3/projects/1ff340ca43524cfdabbc2128feaa8936` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.570184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff340ca43524cfdabbc2128feaa8936)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.572199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.623837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.626009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.642138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1014/2058] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:11.658324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff340ca43524cfdabbc2128feaa8936', 'request_id': 'req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.666479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff340ca43524cfdabbc2128feaa8936', 'request_id': 'req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.677147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff340ca43524cfdabbc2128feaa8936', 'request_id': 'req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.697496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] The token cache is being invalidate because project 1ff340ca43524cfdabbc2128feaa8936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:11.697801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.698710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.700749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1045/2059] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:11 2022] DELETE /identity/v3/projects/1ff340ca43524cfdabbc2128feaa8936 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:11.705637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:11.724639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdcda9-8fe1-4fbb-a2b7-94da0a41a132 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:11.743043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:11.830007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:11.830662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:11.830948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:11.831226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] PATH_INFO: `/v3/users/fad794afa2b149a4a667b4e688233052` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:11.832387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad794afa2b149a4a667b4e688233052)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:11.834654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:11.920656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad794afa2b149a4a667b4e688233052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.939674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad794afa2b149a4a667b4e688233052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.948690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad794afa2b149a4a667b4e688233052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.949504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad794afa2b149a4a667b4e688233052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.951913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-d745fa3d-5973-4c13-95a5-e71152660996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad794afa2b149a4a667b4e688233052'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:11.971347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1015/2060] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:11 2022] DELETE /identity/v3/users/fad794afa2b149a4a667b4e688233052 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:12.462717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:12.464203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:12.488034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091e0e6-ff1d-4b0a-8d59-3eecab560f12 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:12.575966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:12.576703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:12.577583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:12.577583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] PATH_INFO: `/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:12.578652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23df9f6e2c524783b7f72812f6d0fd4d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:12.580705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:12.651560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23df9f6e2c524783b7f72812f6d0fd4d', 'request_id': 'req-90b82318-e0bc-4b90-87c6-0d3e540e3f56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:12.661500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23df9f6e2c524783b7f72812f6d0fd4d', 'request_id': 'req-90b82318-e0bc-4b90-87c6-0d3e540e3f56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:12.662882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:12.674047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23df9f6e2c524783b7f72812f6d0fd4d', 'request_id': 'req-90b82318-e0bc-4b90-87c6-0d3e540e3f56'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:12.691784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] The token cache is being invalidate because project 23df9f6e2c524783b7f72812f6d0fd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:12.692219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:12.692817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-90b82318-e0bc-4b90-87c6-0d3e540e3f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:12.695276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1046/2061] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:12 2022] DELETE /identity/v3/projects/23df9f6e2c524783b7f72812f6d0fd4d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:12.700732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:12.701111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:12.701384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:12.733158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:12.734948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:12.871784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1016/2062] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:12.885759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:12.886052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:12.886336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:12.908290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:12.909568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:12.919433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1047/2063] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:12.923623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:12.934312 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1dcee-e7ad-4bbb-a577-dabbc8cef158 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:12.938865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:12.939476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:12.939762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:12.940039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:12.940844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:12.941152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:12.942783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:12.956367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1017/2064] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:12.960631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:12.974699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa1f68-af5d-422d-bd6f-28b0ae0209f9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:12.978461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:12.978961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:12.979919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:12.979919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:12.980308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:12.982410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.024748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1048/2065] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:12 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:13.028861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.042662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458af98b-c66a-4a06-9ae6-3617f4377ea2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.068302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:13.139772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.140425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.140766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.140994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.141679 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.144128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.184749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1018/2066] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:13 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:13.185075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.203137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6045f84-07c1-4ed5-8845-002147f49bb0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.211217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.211939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.212224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.212512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.213261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.215602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.236274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1049/2067] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:13.236402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.246577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a576c-76f0-41c9-a424-ce9a69b082a4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.254877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.255633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.256008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.256405 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.257264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.259340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356a061-9cd7-408c-bde3-278cc0eddab2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.272563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1019/2068] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:13.277572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.291948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0ec71-4634-46b7-b6a4-590a25c50848 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.298384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.299578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.299864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.300532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] PATH_INFO: `/v3/projects/e3ea437477a54e23bf8cb8b79b614e18/users/ec088b086c434673af1a61b630da6298/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.345731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea437477a54e23bf8cb8b79b614e18, user_id=ec088b086c434673af1a61b630da6298, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.348819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.377517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1050/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:13 2022] PUT /identity/v3/projects/e3ea437477a54e23bf8cb8b79b614e18/users/ec088b086c434673af1a61b630da6298/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:13.388747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.389091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.389403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.449744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] MFA Rules not processed for user `ec088b086c434673af1a61b630da6298`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:13.450970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:13.482778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.484641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:13.534640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1020/2070] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:13.539632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.558421 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-f2fb-4f94-825c-d8e865f1b11b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.563336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.564435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.564781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.565313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.567175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:13.620040 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae4e5-f77d-4745-81d4-9c940cc9c627 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.625410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.625921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.626218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.626491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.627160 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.629079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.638804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.641561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.654395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1051/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:13.671432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1021/2072] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:13 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:13.675450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.687725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa13d30-2ab9-4305-98b9-f367242d0a07 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.752752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:13.800980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.801793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.802248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.802627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.803556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.806553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.838160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1052/2073] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:13 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:13.840838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.857903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495012-d347-45df-abf1-9d91468d8006 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.864069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.865383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.865891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.866620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.867775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.869699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.889340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1022/2074] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:13.894350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.909264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833673-ccfc-4743-ae48-c06673541586 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.918597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:13.919282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:13.919616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:13.919899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] PATH_INFO: `/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259/users/50318414619b4e429196995ff12d6304/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:13.942914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74be4c7e0b7d414896ee3c8c2f54b259, user_id=50318414619b4e429196995ff12d6304, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:13.946579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:13.968222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1053/2075] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:13 2022] PUT /identity/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259/users/50318414619b4e429196995ff12d6304/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:13.973869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:13.986207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef5732-44ad-475c-80b5-bf19d0eaea2b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:13.990623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:14.073684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.074923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.075404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.075860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.076731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.078487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bff75-a7f0-40f4-b568-d00d04b41c35 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.091006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1023/2076] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:14.095659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:14.108959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98ccc-e55a-4f8d-86ab-6f20a0b98110 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:14.114826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.115772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.116756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.117185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] PATH_INFO: `/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259/users/50318414619b4e429196995ff12d6304/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.119444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74be4c7e0b7d414896ee3c8c2f54b259, user_id=50318414619b4e429196995ff12d6304, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.122424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.147326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1054/2077] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:14 2022] PUT /identity/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259/users/50318414619b4e429196995ff12d6304/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:14.154757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.155064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.155315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.192975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] MFA Rules not processed for user `50318414619b4e429196995ff12d6304`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:14.195269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:14.328227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1024/2078] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:14.340593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:14.342595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:14.439343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061479-2541-4f49-9446-96f97c146f81 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:14.446506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.447437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.447901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.448346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.461538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.464157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.487341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1055/2079] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:14.622093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:14.632840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447550b4-3585-4d00-b9f5-c6abb8e86da2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:14.636803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.637447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.637756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.638033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.721997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:14.731317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476196-1883-40f2-bdd4-9a0a626b5a91 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:14.731718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.733516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.736245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.737690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.737980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.738263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.740518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:14.747523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1025/2080] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:14.788480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:14.799875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd85e90-a147-4c2d-87ea-2847223e42ef service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:14.811179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:14.811973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:14.812377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:14.812747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:14.818516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:14.849965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.851714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.857923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:14.864444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1056/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:14.904500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:14.906182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbe758-e785-454a-9e87-6ce0fed6f621 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:14.919732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1026/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:15.508407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:15.586412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:15.637341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a73f-e65f-4955-856c-c5689650d59c service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:15.650546 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:15.651354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:15.651694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:15.652070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] PATH_INFO: `/v3/users/ec088b086c434673af1a61b630da6298` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:15.655487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec088b086c434673af1a61b630da6298)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:15.659566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:15.742908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec088b086c434673af1a61b630da6298'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:15.757454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec088b086c434673af1a61b630da6298'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:15.758518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec088b086c434673af1a61b630da6298'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:15.771290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec088b086c434673af1a61b630da6298'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:15.775228 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec088b086c434673af1a61b630da6298'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:15.797900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1057/2083] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:15 2022] DELETE /identity/v3/users/ec088b086c434673af1a61b630da6298 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:15.799780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:15.800221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:15.800622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:15.830684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:15.832256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:15.932426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1027/2084] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:15.945057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:15.949622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:16.047647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1a9c6-97b7-41de-bfe0-7e89c25ca188 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:16.052403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:16.053107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:16.053778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:16.054130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:16.066745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:16.068736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:16.087512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1058/2085] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:16.710965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:16.712419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:16.733591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b73a7-d5b6-433f-993e-e31de3b08cbb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:16.742592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:16.744291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:16.744291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:16.744291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] PATH_INFO: `/v3/projects/e3ea437477a54e23bf8cb8b79b614e18` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:16.746172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea437477a54e23bf8cb8b79b614e18)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:16.753120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:16.827688 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea437477a54e23bf8cb8b79b614e18', 'request_id': 'req-de3da593-0246-458c-8f22-131a9c8a4732'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:16.842318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea437477a54e23bf8cb8b79b614e18', 'request_id': 'req-de3da593-0246-458c-8f22-131a9c8a4732'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:16.848867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea437477a54e23bf8cb8b79b614e18', 'request_id': 'req-de3da593-0246-458c-8f22-131a9c8a4732'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:16.872922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] The token cache is being invalidate because project e3ea437477a54e23bf8cb8b79b614e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:16.873527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:16.874210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-de3da593-0246-458c-8f22-131a9c8a4732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:16.875718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1028/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:16 2022] DELETE /identity/v3/projects/e3ea437477a54e23bf8cb8b79b614e18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:16.880508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:16.892269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdc817-7b43-41ca-ac33-0671ab258a51 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:16.955694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:16.984379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:16.984379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:16.984379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:16.984379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] PATH_INFO: `/v3/users/50318414619b4e429196995ff12d6304` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:16.984741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50318414619b4e429196995ff12d6304)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:16.987544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:17.066521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50318414619b4e429196995ff12d6304'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.091782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8e98-2ba0-40f2-a563-2fcb6d080a5e None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.092124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8e98-2ba0-40f2-a563-2fcb6d080a5e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.092588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d8e98-2ba0-40f2-a563-2fcb6d080a5e None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.094585 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1029/2087] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:12:17.096194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50318414619b4e429196995ff12d6304'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.097177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50318414619b4e429196995ff12d6304'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.106809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.107379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.107898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.108401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50318414619b4e429196995ff12d6304'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.109856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50318414619b4e429196995ff12d6304'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.134229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:17.136045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.141784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1059/2088] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:16 2022] DELETE /identity/v3/users/50318414619b4e429196995ff12d6304 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:17.185034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:17.186671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.246349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:17.282618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1030/2089] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:17.292054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97579c90-5122-44d2-9f39-12888d91b340 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:17.297722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:17.298513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.298802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.299369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] PATH_INFO: `/v3/users/88c5474b1caa4618a81f5855a49ff515` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.300540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c5474b1caa4618a81f5855a49ff515)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:17.302549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:17.302776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:17.312483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.328660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991575-d7a1-434f-9b3b-92c085972800 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:17.337977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:17.339683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.340078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.340359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.352453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:17.354508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:17.382042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1031/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:17.399818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c5474b1caa4618a81f5855a49ff515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.414879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c5474b1caa4618a81f5855a49ff515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.415776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c5474b1caa4618a81f5855a49ff515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.421210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:17.426819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c5474b1caa4618a81f5855a49ff515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.427777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c5474b1caa4618a81f5855a49ff515'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.456803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1060/2091] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:17 2022] DELETE /identity/v3/users/88c5474b1caa4618a81f5855a49ff515 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:17.542192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:17.543966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.574715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98005-923c-44a0-8021-c4828dab92ed service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:17.653465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:17.654315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.654706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.655136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] PATH_INFO: `/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.656601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74be4c7e0b7d414896ee3c8c2f54b259)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:17.658953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:17.722253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:17.723835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.749830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74be4c7e0b7d414896ee3c8c2f54b259', 'request_id': 'req-0492655e-ea17-48f6-b772-b81f1b31968d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.760163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74be4c7e0b7d414896ee3c8c2f54b259', 'request_id': 'req-0492655e-ea17-48f6-b772-b81f1b31968d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.766915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74be4c7e0b7d414896ee3c8c2f54b259', 'request_id': 'req-0492655e-ea17-48f6-b772-b81f1b31968d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.781206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] The token cache is being invalidate because project 74be4c7e0b7d414896ee3c8c2f54b259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:17.781611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.782535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0492655e-ea17-48f6-b772-b81f1b31968d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.783891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1032/2092] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:17 2022] DELETE /identity/v3/projects/74be4c7e0b7d414896ee3c8c2f54b259 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:17.788090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb47e3-be80-47c6-9821-536a180e6753 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:17.790727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3658-3089-4ac2-aef1-4cfb90558028 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.791172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3658-3089-4ac2-aef1-4cfb90558028 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.791435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3658-3089-4ac2-aef1-4cfb90558028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.817553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-af6b3658-3089-4ac2-aef1-4cfb90558028 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:17.818955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-af6b3658-3089-4ac2-aef1-4cfb90558028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.885669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:17.886457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.886742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.887016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] PATH_INFO: `/v3/projects/b44ac94c10c24033ac90cae24c9af051` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.888250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44ac94c10c24033ac90cae24c9af051)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:17.890873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:17.899258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:17.921466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1033/2093] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:17.931050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:17.933403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:17.933911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:17.962720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:17.964669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:17.973454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44ac94c10c24033ac90cae24c9af051', 'request_id': 'req-46bf4d75-99ab-4b90-9c7a-8f76366d518a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.981838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44ac94c10c24033ac90cae24c9af051', 'request_id': 'req-46bf4d75-99ab-4b90-9c7a-8f76366d518a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:17.989744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44ac94c10c24033ac90cae24c9af051', 'request_id': 'req-46bf4d75-99ab-4b90-9c7a-8f76366d518a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.005597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] The token cache is being invalidate because project b44ac94c10c24033ac90cae24c9af051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:18.005889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.006637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-46bf4d75-99ab-4b90-9c7a-8f76366d518a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.009676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1061/2094] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:17 2022] DELETE /identity/v3/projects/b44ac94c10c24033ac90cae24c9af051 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:18.017874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793b79-e640-4500-a745-78634a5cce52 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.018552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793b79-e640-4500-a745-78634a5cce52 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.019099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b793b79-e640-4500-a745-78634a5cce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.049151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4b793b79-e640-4500-a745-78634a5cce52 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:18.049151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4b793b79-e640-4500-a745-78634a5cce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.049800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1034/2095] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:18.051066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.068044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217492-f7e6-485d-b57f-3caa25c7a75a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.071984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1062/2096] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:18.080102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.080394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.080724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.083840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.084617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.085104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.085481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.086387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:18.086821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.097753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.104191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:18.105729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.114340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1063/2097] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:18.119311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.124856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1035/2098] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:18.126469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.136199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46c2b-2f09-4ed9-ad5d-32a9e123a094 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.141622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5bed-9164-4530-ba6c-f58f9895e435 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.146194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.147141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.147582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.147705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.148147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.148587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.148956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.149499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:18.150104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.151922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.153497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.154722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.157409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.171051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1064/2099] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:12:18.175442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.187903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e53a-cdcf-4fb9-8c5d-3e035e213b2c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.193889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.195139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.195586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.195869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.196704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.198540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1036/2100] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:18.199538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.202863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.237534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1065/2101] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:18.238588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.273998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:18.290433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397f3f-64ed-4be9-896e-29d6dc8df534 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.311948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b717c5-41a6-463d-a561-5c8a4e413c8e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.317393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.318007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.318290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.318569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.319273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.322362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.347692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1066/2102] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:18.352330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.354344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.355018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.355325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.355596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.356387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.358641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.363442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c9f59-25db-450e-bfc2-e2ef68416d26 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.369981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.370701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.371085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.371303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.372027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.373890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.378762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:18.387975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1067/2103] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:18.388844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.389756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1037/2104] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/users => generated 281 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:18.390647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.400081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809dec-0162-4ec2-a37d-a97c5f0c844c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.403230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266d710-7d98-48b9-82b9-ffae1b57327f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.405190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.405824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.406100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.406382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.407230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.409343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.410340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.411577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.411925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.412262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.413616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.416201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.421620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1068/2105] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:18.425859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.431816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1038/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:18.432716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.443546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e494c7-0d18-489c-8cf8-38cc3e2a2464 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.447574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e1dba-9798-4a97-bb94-79a0bd10f265 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.448791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.449500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.449788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.450065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.450744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.452419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.455117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.455800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.456075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.456356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] PATH_INFO: `/v3/projects/b3297ab419b04e7faf1738e64ab28c3c/users/5fca6a15a17c423393582da43abec450/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.467375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1039/2107] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:18.472081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.482515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3297ab419b04e7faf1738e64ab28c3c, user_id=5fca6a15a17c423393582da43abec450, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.485850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af1c9c-c329-465f-b90d-3c26f07decb6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.491859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe885f5-c5f2-4a64-bb9e-b4d924a78909 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.498041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.498608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.498918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.499251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] PATH_INFO: `/v3/projects/73d46100cd2d4253b4d1b64ccc388a12/users/ed0cda84622142b38d69a1416a51536c/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.513333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1069/2108] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:18 2022] PUT /identity/v3/projects/b3297ab419b04e7faf1738e64ab28c3c/users/5fca6a15a17c423393582da43abec450/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:18.518601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.519150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.519633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.520835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d46100cd2d4253b4d1b64ccc388a12, user_id=ed0cda84622142b38d69a1416a51536c, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.524033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8682-c9ea-45cb-85b2-2d05c17a001c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.541952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:18.543068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.543254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1040/2109] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:18 2022] PUT /identity/v3/projects/73d46100cd2d4253b4d1b64ccc388a12/users/ed0cda84622142b38d69a1416a51536c/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:18.555157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.555450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.555734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.590995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] MFA Rules not processed for user `ed0cda84622142b38d69a1416a51536c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:18.592386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.628041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1070/2110] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:18.642012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.644305 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.674082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1041/2111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:18.711714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.713661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.732862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec51a-b25b-4a6a-a5db-c7909663da22 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.737033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.737919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.738217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.738495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.750084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.750883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.761994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1071/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:18.780533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1afac4-a370-4447-ad73-83de9926e3ce None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.799518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.800368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.801032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.801349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.812924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.814980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.826085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1042/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:18.849211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.863929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7aea-b75b-4abe-b68c-3b6ecbc1ea42 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.870127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.871035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.871218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.871553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] PATH_INFO: `/v3/users/ed0cda84622142b38d69a1416a51536c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.872724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0cda84622142b38d69a1416a51536c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.875020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.889263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:18.921331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:18.923390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:18.934465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0cda84622142b38d69a1416a51536c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.939553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34f08-232a-48e3-b928-9fc6c5c17c8d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:18.946269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:18.947118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:18.947552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:18.947999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] PATH_INFO: `/v3/users/dae83b44b67b4811871d0077feba6375` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:18.949686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae83b44b67b4811871d0077feba6375)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:18.951280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0cda84622142b38d69a1416a51536c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.952069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0cda84622142b38d69a1416a51536c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.952197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:18.963125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0cda84622142b38d69a1416a51536c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.964574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-102c8c8a-d76b-45a0-8cf1-39b32d61931d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0cda84622142b38d69a1416a51536c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:18.999072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1072/2114] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:18 2022] DELETE /identity/v3/users/ed0cda84622142b38d69a1416a51536c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:19.003748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.003985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.004513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.017007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:19.023657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae83b44b67b4811871d0077feba6375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.033508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:19.034821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.038502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae83b44b67b4811871d0077feba6375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.046957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae83b44b67b4811871d0077feba6375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.047606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae83b44b67b4811871d0077feba6375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.048251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-68979aee-b941-498e-aa2b-87ff580c3fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae83b44b67b4811871d0077feba6375'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.063227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1043/2115] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:18 2022] DELETE /identity/v3/users/dae83b44b67b4811871d0077feba6375 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:19.067383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.067746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.068055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.094639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:19.096030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.106793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1073/2116] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:19.117036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:19.123412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.267842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1044/2117] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:19.273889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c13e-d0b6-4c99-927b-339e52f3e5d1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:19.279366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:19.280728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.382016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:19.396936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:19.398703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.399286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.399762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.400532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cf30d-b997-4bda-a84c-ac8c521fa43e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:19.411218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:19.413482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:19.414535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:19.415347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.415778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.416203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.435936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:19.438598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f621a-6f64-4d67-b475-a19699081ad8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:19.443518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1074/2118] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:19.444976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:19.456314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1045/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:19.458395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.472255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3395-9710-449a-82d6-dae21c0a3a08 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:19.477089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:19.477993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.478757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.478883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] PATH_INFO: `/v3/users/dd4b61a87f8e4fd084546e3ee2db47f1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.480370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4b61a87f8e4fd084546e3ee2db47f1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:19.482712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:19.581932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4b61a87f8e4fd084546e3ee2db47f1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.605580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4b61a87f8e4fd084546e3ee2db47f1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.606583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4b61a87f8e4fd084546e3ee2db47f1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.614678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4b61a87f8e4fd084546e3ee2db47f1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.615713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4b61a87f8e4fd084546e3ee2db47f1'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:19.646978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1075/2120] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:19 2022] DELETE /identity/v3/users/dd4b61a87f8e4fd084546e3ee2db47f1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:19.651589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.652148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.652642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.687591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:19.689620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.818029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1046/2121] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:19.839230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:19.840890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.914592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682eac7-c5df-49d7-93b3-4b329eee718f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:19.921001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:19.922048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.922480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.923077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.952125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:19.954211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:19.961642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:19.963419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:19.973834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:19.985758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798a1ed-9a41-4a9b-b8aa-eebdcb3d39e4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:19.986162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1076/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:19.993682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:19.994443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:19.994849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:19.995224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] PATH_INFO: `/v3/projects/af5540ac1afc414bb1d737b6ed86e8f0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:19.996638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5540ac1afc414bb1d737b6ed86e8f0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:19.999176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:20.075844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5540ac1afc414bb1d737b6ed86e8f0', 'request_id': 'req-999d0a50-0979-4443-ba21-51fc2ae96502'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.087283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5540ac1afc414bb1d737b6ed86e8f0', 'request_id': 'req-999d0a50-0979-4443-ba21-51fc2ae96502'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.099128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5540ac1afc414bb1d737b6ed86e8f0', 'request_id': 'req-999d0a50-0979-4443-ba21-51fc2ae96502'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.131270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] The token cache is being invalidate because project af5540ac1afc414bb1d737b6ed86e8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:20.132612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.133731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.135478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1047/2123] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:19 2022] DELETE /identity/v3/projects/af5540ac1afc414bb1d737b6ed86e8f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:20.140010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:20.155132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333b3a-aed9-4c31-a5dd-84ad523abb47 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:20.235897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:20.236690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.236985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.238074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] PATH_INFO: `/v3/users/f16503f8cdae4e4b9ace139cddc9d084` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.239311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16503f8cdae4e4b9ace139cddc9d084)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:20.242573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:20.247667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:20.262748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:20.264631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:20.290778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d0a50-0979-4443-ba21-51fc2ae96502 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:20.304300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:20.304945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.305254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.305523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] PATH_INFO: `/v3/projects/73d46100cd2d4253b4d1b64ccc388a12` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.312782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d46100cd2d4253b4d1b64ccc388a12)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:20.315110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:20.383402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16503f8cdae4e4b9ace139cddc9d084'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.384338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d46100cd2d4253b4d1b64ccc388a12', 'request_id': 'req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.396767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d46100cd2d4253b4d1b64ccc388a12', 'request_id': 'req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.407309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16503f8cdae4e4b9ace139cddc9d084'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.408345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16503f8cdae4e4b9ace139cddc9d084'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.408477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d46100cd2d4253b4d1b64ccc388a12', 'request_id': 'req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.432638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16503f8cdae4e4b9ace139cddc9d084'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.433163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] The token cache is being invalidate because project 73d46100cd2d4253b4d1b64ccc388a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:20.433724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7e51a587-7e9f-4297-b5f9-818939eefefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16503f8cdae4e4b9ace139cddc9d084'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.433839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.436209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.440242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1048/2124] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:20 2022] DELETE /identity/v3/projects/73d46100cd2d4253b4d1b64ccc388a12 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:20.441267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:20.443390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:20.475436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1077/2125] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:20 2022] DELETE /identity/v3/users/f16503f8cdae4e4b9ace139cddc9d084 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:20.476954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.477422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.478258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.527436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:20.530011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:20.534557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e484-f2ce-4f7c-a9cc-2e1d4dda37b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:20.552970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:20.667077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:20.668048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.669930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.671030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] PATH_INFO: `/v3/users/b7f4b6124680447b82f9fc309d5b7dbe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.675593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f4b6124680447b82f9fc309d5b7dbe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:20.680024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1078/2126] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:20.681037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:20.681665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:20.683256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:20.698734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0a624-e42e-4266-a657-fce04928f25e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:20.705772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:20.707721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.708282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.708975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] PATH_INFO: `/v3/projects/e18b7724e74b426e9d786843b5ce7c6c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.711101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18b7724e74b426e9d786843b5ce7c6c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:20.714618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:20.799353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f4b6124680447b82f9fc309d5b7dbe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.841602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f4b6124680447b82f9fc309d5b7dbe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.849095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18b7724e74b426e9d786843b5ce7c6c', 'request_id': 'req-6339e4eb-58c2-4ba6-ac45-9346097b4892'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.855448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f4b6124680447b82f9fc309d5b7dbe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.856217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f4b6124680447b82f9fc309d5b7dbe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.858564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b3d5d85d-9dd1-4540-aed4-2218372e0bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f4b6124680447b82f9fc309d5b7dbe'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.864400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18b7724e74b426e9d786843b5ce7c6c', 'request_id': 'req-6339e4eb-58c2-4ba6-ac45-9346097b4892'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.892058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1049/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:20 2022] DELETE /identity/v3/users/b7f4b6124680447b82f9fc309d5b7dbe => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:20.894243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.894633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.895007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.909927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18b7724e74b426e9d786843b5ce7c6c', 'request_id': 'req-6339e4eb-58c2-4ba6-ac45-9346097b4892'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.919492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:20.921027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:20.957548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] The token cache is being invalidate because project e18b7724e74b426e9d786843b5ce7c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:20.958574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.960138 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6339e4eb-58c2-4ba6-ac45-9346097b4892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:20.962265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1079/2128] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:20 2022] DELETE /identity/v3/projects/e18b7724e74b426e9d786843b5ce7c6c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:20.964079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:20.964600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:20.965147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:20.983094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:21.004237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:21.005930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.109294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1050/2129] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:21.110572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.112061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.134441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca9fad-78f9-41d0-8a17-0577842a4390 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.152059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.152712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.152995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.153295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] PATH_INFO: `/v3/users/c997daca3f114a53848e247eed3965fb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.155607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c997daca3f114a53848e247eed3965fb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.157443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.188665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1080/2130] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:21.189920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.202853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e099b1-f56f-43c5-88bd-dc741f687c9e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.212100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.213582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.214093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.214523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.215385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:21.216279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.229665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.236896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:21.254560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1081/2131] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:21.255818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.258183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.275296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c997daca3f114a53848e247eed3965fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.306551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c997daca3f114a53848e247eed3965fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.322127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c997daca3f114a53848e247eed3965fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.323050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c997daca3f114a53848e247eed3965fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.323963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c997daca3f114a53848e247eed3965fb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.328552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8ad2d-7656-4e31-b82f-f76e2f3faeaf admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.332399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.333146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.333325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.333604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.335571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.352049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.353706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.354271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1051/2132] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:21 2022] DELETE /identity/v3/users/c997daca3f114a53848e247eed3965fb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:21.355707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.362212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.369636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1082/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:21.402418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.404615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.424534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3edd6b-81d0-42eb-8448-c440b46773b9 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.540271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090266cf-181f-4483-968c-06f1c315f02e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.548366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.548911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.549842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.550150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.551125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.552906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.555870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.558129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.558309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.559675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] PATH_INFO: `/v3/projects/22edde3ef6d746b4a45977afaf0c9747` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.563266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22edde3ef6d746b4a45977afaf0c9747)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.570757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.608675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1052/2134] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:21 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:21.613503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.662687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:21.681884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22edde3ef6d746b4a45977afaf0c9747', 'request_id': 'req-a22022bd-9437-4568-8c0c-104e12f174c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.697812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22edde3ef6d746b4a45977afaf0c9747', 'request_id': 'req-a22022bd-9437-4568-8c0c-104e12f174c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.706458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22edde3ef6d746b4a45977afaf0c9747', 'request_id': 'req-a22022bd-9437-4568-8c0c-104e12f174c3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.743929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] The token cache is being invalidate because project 22edde3ef6d746b4a45977afaf0c9747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:21.744231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.745024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a22022bd-9437-4568-8c0c-104e12f174c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:21.745403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026703ae-b262-40fc-927b-2b547fd2078a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.749999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1083/2135] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:21 2022] DELETE /identity/v3/projects/22edde3ef6d746b4a45977afaf0c9747 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:21.751569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758393-41cd-4b46-ab01-438789f94371 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.751860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758393-41cd-4b46-ab01-438789f94371 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.752144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758393-41cd-4b46-ab01-438789f94371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.791500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-03758393-41cd-4b46-ab01-438789f94371 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:21.792761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-03758393-41cd-4b46-ab01-438789f94371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.821802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:21.850861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.851842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.852677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.853027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.854489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.856337 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.893846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1053/2136] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:21 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:21.899303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.901088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.906661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1084/2137] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:21.916036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.916418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.916762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.930772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b7ee-6557-4c35-91bb-34bf08cbfa41 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.943620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.945093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.946227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.947666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.948412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:21.952757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:21.968010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:21.971758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1054/2138] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:21.975754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:21.976417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.989723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1085/2139] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:21.989936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7a1ae-dd73-4b14-b549-9b4888ebca66 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:21.992741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:21.996739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:21.997838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:21.998227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:21.999248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:21.999990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.001779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.004135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b3356-6e07-408f-a38c-89650587667d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.011608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.012522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.012924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.013358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.014266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:22.014693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.018446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.019752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1055/2140] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:22.026538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.047406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0d28-df1b-4a23-be4e-2164543b81b0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.055392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1086/2141] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:22.059749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.059922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.060577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.061039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.061373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] PATH_INFO: `/v3/projects/b093f65f011b4f458e742b02727391ba/users/b33c69ddf07d48dd8c4c377cd8d71f0b/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.078660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed5a3-2d80-408a-bd06-28358a1dcdb0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.084233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b093f65f011b4f458e742b02727391ba, user_id=b33c69ddf07d48dd8c4c377cd8d71f0b, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.084766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.085448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.085771 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.086006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.086654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.088214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1a901-3b79-4caf-9375-9d6b0f9772ab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.088748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.112272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1056/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:22 2022] PUT /identity/v3/projects/b093f65f011b4f458e742b02727391ba/users/b33c69ddf07d48dd8c4c377cd8d71f0b/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:22.124920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.125213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.125439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.137309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1087/2143] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:22 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:22.148645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.207473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] MFA Rules not processed for user `b33c69ddf07d48dd8c4c377cd8d71f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:22.208970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.254177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ed2fa-b613-4f38-a5ed-219bc23af07a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.260967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.261688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.262229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.262671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.263847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.265509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.295394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1088/2144] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:22 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:22.299432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.329141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c176b2-104f-4c48-86c3-34bab7ee1468 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.344744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.351369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1057/2145] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:22.354163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.354445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.354743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.356202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.361798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.369068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.371288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.390171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1089/2146] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:22.394428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.407322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:22.414551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a204-2a63-4991-bb13-03153316d5ec admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.427547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.429331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.429831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.430398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.431803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.435328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.455912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1090/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:22.458514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.480766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89400ce-db04-4b4d-9a1f-b0cdc6aec4ad None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.502491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.502491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.502491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.502491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.510100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44fc30-ebec-48bc-8cc3-6ce991de8c0a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.514272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.515882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.517493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.518547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.518939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.519321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] PATH_INFO: `/v3/projects/fe6f5da09c004291a42c942f65fe962c/users/cd8b71c30c364f6c84112b73e357d508/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.542289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6f5da09c004291a42c942f65fe962c, user_id=cd8b71c30c364f6c84112b73e357d508, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.548067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f682f4-533f-42b0-9175-ab7ade6b2702 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.558683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1058/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:22.561667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.566828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.590855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1091/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:22 2022] PUT /identity/v3/projects/fe6f5da09c004291a42c942f65fe962c/users/cd8b71c30c364f6c84112b73e357d508/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:22.599584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093ef2-c22c-4561-910d-03746dc76d5c service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.602079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.603124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.603478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.649888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:22.683710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] MFA Rules not processed for user `cd8b71c30c364f6c84112b73e357d508`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:22.684964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.746613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.747376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.747726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.748068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] PATH_INFO: `/v3/projects/22425229f822435897f140f9161c9d7f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.750528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22425229f822435897f140f9161c9d7f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.752560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.790479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1092/2150] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:22.791428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.792839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.811585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb255-d54c-4567-af76-dac1b8ddcfa1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:22.817045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:22.817993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:22.818275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:22.818617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] PATH_INFO: `/v3/projects/d35719eb6d284d7e8dfaae0076716271` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:22.822264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35719eb6d284d7e8dfaae0076716271)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:22.824429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:22.856735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22425229f822435897f140f9161c9d7f', 'request_id': 'req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.873982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22425229f822435897f140f9161c9d7f', 'request_id': 'req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.892212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22425229f822435897f140f9161c9d7f', 'request_id': 'req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.898900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35719eb6d284d7e8dfaae0076716271', 'request_id': 'req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.910928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35719eb6d284d7e8dfaae0076716271', 'request_id': 'req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.916377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] The token cache is being invalidate because project 22425229f822435897f140f9161c9d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:22.916694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.917411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.918931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1059/2151] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:22 2022] DELETE /identity/v3/projects/22425229f822435897f140f9161c9d7f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:22.919671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.921070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:22.923360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35719eb6d284d7e8dfaae0076716271', 'request_id': 'req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.941900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] The token cache is being invalidate because project d35719eb6d284d7e8dfaae0076716271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:22.942233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.949815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:22.951789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1093/2152] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:22 2022] DELETE /identity/v3/projects/d35719eb6d284d7e8dfaae0076716271 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:22.952595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:22.954447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:23.049690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:23.079598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342c724-b2a4-4cd0-8f3b-e047e89d0b75 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.085297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd178f9-0e86-46a2-b413-2d9f9a21a18f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.090977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.091725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.092387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.092767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] PATH_INFO: `/v3/users/197910f385e14a13986253224abc6708` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.094739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.095514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.095978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=197910f385e14a13986253224abc6708)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.097425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.097776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.098564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.098682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.101524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.164664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1060/2153] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:22 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:23.165555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:23.173211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:23.202415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197910f385e14a13986253224abc6708'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.237780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:23.259271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197910f385e14a13986253224abc6708'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.261674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197910f385e14a13986253224abc6708'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.278924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197910f385e14a13986253224abc6708'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.279872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197910f385e14a13986253224abc6708'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.300254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33742a6b-f9b1-4dfc-889a-43e755c5023d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.304206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1094/2154] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:22 2022] DELETE /identity/v3/users/197910f385e14a13986253224abc6708 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:23.308293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:23.309583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.311960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.312662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.313586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] PATH_INFO: `/v3/users/d2a7865fd48e4e9283eaa178f87b8caf` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.316474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:23.318255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a7865fd48e4e9283eaa178f87b8caf)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.323082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.445931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a7865fd48e4e9283eaa178f87b8caf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.477141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a7865fd48e4e9283eaa178f87b8caf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.485024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468def1-5c1d-4fbb-8382-c24f99e3db8a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.514408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a7865fd48e4e9283eaa178f87b8caf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.515454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a7865fd48e4e9283eaa178f87b8caf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.516514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a7865fd48e4e9283eaa178f87b8caf'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:23.535448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.537256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1061/2155] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:23 2022] DELETE /identity/v3/users/d2a7865fd48e4e9283eaa178f87b8caf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:23.542926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.543442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.543552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.547793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.552392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.626817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1095/2156] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:23 2022] POST /identity/v3/users => generated 295 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:23.628422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:23.631197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:23.731353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8c53c-cf5b-44a2-9bf7-0a393458ed13 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.739865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.740793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.741880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.742823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.744046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.746486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.761419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1062/2157] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:23.766335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:23.782878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adc803-9875-49a6-93a5-dacf5bb3c718 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.789087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.790280 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.790708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.791154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] PATH_INFO: `/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9/users/c7db6b94fa414a119489549c9924682f/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.813084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97984bcbe4fd411eb6babd4aa7bb09a9, user_id=c7db6b94fa414a119489549c9924682f, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.818052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.845681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1096/2158] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:23 2022] PUT /identity/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9/users/c7db6b94fa414a119489549c9924682f/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:23.848232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:23.862799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c694eb-3f67-4354-b189-b10a3a042b6f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:23.956135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:23.972319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:23.973095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:23.974156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:23.975091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:23.975971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:23.978653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:23.996940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1063/2159] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:24.000682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:24.015872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e46b14-c6b5-4ba6-a764-4e2612ecfbfd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:24.021757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:24.022559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.022914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.023433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] PATH_INFO: `/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9/users/c7db6b94fa414a119489549c9924682f/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.025725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97984bcbe4fd411eb6babd4aa7bb09a9, user_id=c7db6b94fa414a119489549c9924682f, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:24.027877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:24.029534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.045795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4af868-ac8b-40c9-9078-854fc6677204 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:24.065132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1583-a508-4809-babb-57fc3065e3e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:24.097786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1097/2160] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:23 2022] PUT /identity/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9/users/c7db6b94fa414a119489549c9924682f/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:24.098326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:24.098326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.098326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.098326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] PATH_INFO: `/v3/projects/21cbd2e8983d41b6bdce8982ed700b43` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.100627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cbd2e8983d41b6bdce8982ed700b43)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:24.101191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.101521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.101799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.102808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:24.163070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:24.186375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] MFA Rules not processed for user `c7db6b94fa414a119489549c9924682f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:24.187666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.210148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cbd2e8983d41b6bdce8982ed700b43', 'request_id': 'req-f4ab551d-0446-4af2-8d77-2b269ad06342'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.229314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cbd2e8983d41b6bdce8982ed700b43', 'request_id': 'req-f4ab551d-0446-4af2-8d77-2b269ad06342'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.239010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cbd2e8983d41b6bdce8982ed700b43', 'request_id': 'req-f4ab551d-0446-4af2-8d77-2b269ad06342'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.264866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] The token cache is being invalidate because project 21cbd2e8983d41b6bdce8982ed700b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:24.264866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.281187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f4ab551d-0446-4af2-8d77-2b269ad06342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.283016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1064/2161] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:24 2022] DELETE /identity/v3/projects/21cbd2e8983d41b6bdce8982ed700b43 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:24.294764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.295135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.295404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.353533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:24.354982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.379504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1098/2162] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:24.384330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:24.385764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.469779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1065/2163] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:24.470889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:24.472664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.530424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcca4fa-4b2a-4f6e-a509-9552016fa4af None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:24.543472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:24.546170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.547143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.548541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] PATH_INFO: `/v3/projects/2bb787a59d3b46b29a599ee7c0832f70` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.550821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb787a59d3b46b29a599ee7c0832f70)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:24.552787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:24.605946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b098e6f-9723-45c9-ba50-84c864638f25 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:24.611731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:24.612961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.613415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.613900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.616915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.652870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:24.665444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb787a59d3b46b29a599ee7c0832f70', 'request_id': 'req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.678360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb787a59d3b46b29a599ee7c0832f70', 'request_id': 'req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.687324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb787a59d3b46b29a599ee7c0832f70', 'request_id': 'req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.713061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] The token cache is being invalidate because project 2bb787a59d3b46b29a599ee7c0832f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:24.713678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.714641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e55f9ec-9e7f-44f2-9cb9-ec9bff4d938c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:24.716549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1099/2164] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:24 2022] DELETE /identity/v3/projects/2bb787a59d3b46b29a599ee7c0832f70 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:24.718189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.718542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.718826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.762076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:24.764048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411596b-7cd4-4b33-8a54-80b91a07dc6c service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:24.774795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:24.776149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.792489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1066/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:24.794278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2ff1-ba25-4c80-a1af-0871963728b1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:24.794571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2ff1-ba25-4c80-a1af-0871963728b1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:24.795198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2ff1-ba25-4c80-a1af-0871963728b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:24.845963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:24.864380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-852b2ff1-ba25-4c80-a1af-0871963728b1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:24.866609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-852b2ff1-ba25-4c80-a1af-0871963728b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:24.950442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1100/2166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:24.951648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:24.990052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaa4e-fe0b-4a5c-9df2-25b641be142d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.002093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.002714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.002996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.003380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.004053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:25.004362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.007449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.040140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1101/2167] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:25.046600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.063762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e955c-7330-4142-8f53-3b85258e9677 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.074005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1067/2168] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:25.075901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.076239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.076451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.076570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.077024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.077329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.077606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.078234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.080483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.103094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:25.104844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:25.119318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1068/2169] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:25.123550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.145165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8837c9-b83f-4364-9d0d-2c50231fa043 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.147016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1102/2170] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:25.151073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.246484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.247031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.248164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.248856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.254856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:25.254856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.259409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.274455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e7ce-6c14-4c9d-8d15-858960654191 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.280194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.280766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1069/2171] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:25.280919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.281250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.281581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.282279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.284699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.285946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.305603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfa4c9-aa3c-4875-9372-b801560e9f62 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.310991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.311837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.312559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1103/2172] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:25.315274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.315797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.316507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.316656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.318804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.342929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7d4d-8000-4373-acf8-e2bc58e930c5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.354798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1070/2173] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:25.354949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.355368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.355653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.355925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.356581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.358246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.367054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.390349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1104/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:25.391760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.410766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9422f-4ace-48a4-a302-16f4100475de admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.413308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:25.506701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e905b9-f5ec-4b0d-817f-fe6465bd794a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.525795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.526444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.526758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.527009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.527665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.532920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.571616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.572492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.572729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.573000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.573669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.576009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.596724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1105/2175] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:25.602037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1071/2176] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:25.602599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.607824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.632667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54400e5d-c4ad-418c-bae6-334c05c0441e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.638826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.639732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.640292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.640824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] PATH_INFO: `/v3/projects/d379a725c1474bb7908ee988c24db010/users/e8134b7a1e974d8087b92d41b6fee45f/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.644859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:25.646091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6434f-cac7-4a3d-bf64-f2451a9a08a2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.675025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.675641 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.676491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.676728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.677496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.679125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.686894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d379a725c1474bb7908ee988c24db010, user_id=e8134b7a1e974d8087b92d41b6fee45f, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.697048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f34f7-5c34-4cc6-8438-f49dc8518390 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.706185 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1072/2177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:25.710820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.728203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b476d-773a-48a4-b165-65618a8b9ddb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.738890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1106/2178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:25 2022] PUT /identity/v3/projects/d379a725c1474bb7908ee988c24db010/users/e8134b7a1e974d8087b92d41b6fee45f/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:25.751900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.752286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.752583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.825125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.826539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.827406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.827406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.830491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.832777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.838285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] MFA Rules not processed for user `e8134b7a1e974d8087b92d41b6fee45f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:25.839608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:25.850684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1073/2179] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:25.855413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:25.887749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ea7c-ec59-43f5-94a2-673f0eb462b2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:25.904662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:25.906117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:25.906403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:25.906687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] PATH_INFO: `/v3/projects/4ee184de1a764cb491848ac692efd21c/users/f93fd1c9b91a4705a02229b909158004/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:25.958649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee184de1a764cb491848ac692efd21c, user_id=f93fd1c9b91a4705a02229b909158004, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:25.963838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70f93c-0e66-40d2-a73b-e98223e58d5e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:25.997311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1107/2180] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:26.009084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:26.011072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.020879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1074/2181] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:25 2022] PUT /identity/v3/projects/4ee184de1a764cb491848ac692efd21c/users/f93fd1c9b91a4705a02229b909158004/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:26.026579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.026997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.027155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.065535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:26.067141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.125163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606999b-0f9e-460f-9cad-982980e82b82 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:26.193677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1075/2182] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:26.204639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:26.206872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.237773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:26.238538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:26.239710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.240058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.240410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.294627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f36e8-4d51-45b2-a1d1-9c012ef7060f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:26.300931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:26.301776 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.302224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.302642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.311683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:26.315788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:26.317618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31d13c-78c2-45ec-8418-e38fb48999cb service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:26.331589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1076/2183] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:26.349715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:26.352027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:26.371091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.371717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.372179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.375928 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1108/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:26.397049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:26.409381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc41870-768f-41c2-b4cd-d97833181d57 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:26.411336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] MFA Rules not processed for user `5fca6a15a17c423393582da43abec450`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:26.412663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.414284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:26.414922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.415206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.415480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] PATH_INFO: `/v3/users/e8134b7a1e974d8087b92d41b6fee45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.416723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8134b7a1e974d8087b92d41b6fee45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:26.418577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:26.483425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8134b7a1e974d8087b92d41b6fee45f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:26.501012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8134b7a1e974d8087b92d41b6fee45f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:26.501962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8134b7a1e974d8087b92d41b6fee45f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:26.509331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1077/2185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:26.513559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8134b7a1e974d8087b92d41b6fee45f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:26.514254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-65001e89-10e5-4eeb-84a7-651456bb8f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8134b7a1e974d8087b92d41b6fee45f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:26.518475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:26.520299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.530139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1109/2186] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:26 2022] DELETE /identity/v3/users/e8134b7a1e974d8087b92d41b6fee45f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:26.535160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.535509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.535813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.558577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:26.559999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.691107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ce5a-72fc-41c2-b70a-4fcc9a9fbde3 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:26.716607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1110/2187] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:26.761154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:26.774644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.811975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:26.884962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:26.885616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.888637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.888963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.898874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:26.901369 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969f4a-6688-41c7-8c4f-64c29b11ed5e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:26.913997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:26.914766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:26.915180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:26.916326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:26.949620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:26.955197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:26.967304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:26.977535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1111/2188] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:27.037106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:27.039558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.071615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be628-0102-4749-b596-bd73ff560312 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:27.082285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:27.084136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d15ac-cd9a-447e-9124-52af4f2a76d8 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:27.093730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:27.094412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.095059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.095059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] PATH_INFO: `/v3/users/b33c69ddf07d48dd8c4c377cd8d71f0b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.096124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33c69ddf07d48dd8c4c377cd8d71f0b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:27.098080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:27.110538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1078/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:27.163474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33c69ddf07d48dd8c4c377cd8d71f0b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.193550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33c69ddf07d48dd8c4c377cd8d71f0b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.194857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33c69ddf07d48dd8c4c377cd8d71f0b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.205870 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33c69ddf07d48dd8c4c377cd8d71f0b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.206815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33c69ddf07d48dd8c4c377cd8d71f0b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.239172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1112/2190] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:27 2022] DELETE /identity/v3/users/b33c69ddf07d48dd8c4c377cd8d71f0b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:27.251924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83e9d-24fe-4670-bcca-6cd0a9664728 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.253198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83e9d-24fe-4670-bcca-6cd0a9664728 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.254101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83e9d-24fe-4670-bcca-6cd0a9664728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.281156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-beb83e9d-24fe-4670-bcca-6cd0a9664728 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:27.282563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-beb83e9d-24fe-4670-bcca-6cd0a9664728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.361807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1079/2191] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:27.376872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:27.387021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.492581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12859-dcad-434e-b0b8-9e72496a1a6d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:27.508654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:27.509931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.510417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.510906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.525300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:27.527062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:27.547708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1113/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:27.688873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.689162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.689471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.694722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:27.696171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.718995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d392d0-aac4-4ea5-8edd-a39743b6755a service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:27.730289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:27.731457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.731751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.732018 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] PATH_INFO: `/v3/projects/d379a725c1474bb7908ee988c24db010` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.733208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d379a725c1474bb7908ee988c24db010)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:27.735604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:27.752589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] MFA Rules not processed for user `f93fd1c9b91a4705a02229b909158004`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:27.753827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.820802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd379a725c1474bb7908ee988c24db010', 'request_id': 'req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.834493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd379a725c1474bb7908ee988c24db010', 'request_id': 'req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.847611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd379a725c1474bb7908ee988c24db010', 'request_id': 'req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.881984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:27.901572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] The token cache is being invalidate because project d379a725c1474bb7908ee988c24db010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:27.903242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.904173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3f0fbe8b-aab1-4956-a114-8ba24c4f7513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:27.918926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1114/2193] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:27 2022] DELETE /identity/v3/projects/d379a725c1474bb7908ee988c24db010 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:27.925279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:27.925911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:27.927319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:27.930701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1080/2194] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:27.944370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:27.946189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.981725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:27.984010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:27.988832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:28.075353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160980-0449-4bbd-b630-86b8d25794d2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.126322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1115/2195] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:28.127411 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.134126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.155110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ee6be-2600-4219-867c-1739c588ed93 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.174795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.175954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.176241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.176514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] PATH_INFO: `/v3/projects/b093f65f011b4f458e742b02727391ba` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.180762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b093f65f011b4f458e742b02727391ba)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.183431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.206615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.207304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.207587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.207862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.215561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.252833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b093f65f011b4f458e742b02727391ba', 'request_id': 'req-9ac9f871-010f-40f6-b863-3370e2c7b7bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:28.281132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b093f65f011b4f458e742b02727391ba', 'request_id': 'req-9ac9f871-010f-40f6-b863-3370e2c7b7bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:28.297949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b093f65f011b4f458e742b02727391ba', 'request_id': 'req-9ac9f871-010f-40f6-b863-3370e2c7b7bc'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:28.326721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] The token cache is being invalidate because project b093f65f011b4f458e742b02727391ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:28.327068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:28.328350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9ac9f871-010f-40f6-b863-3370e2c7b7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:28.330984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1116/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:28 2022] DELETE /identity/v3/projects/b093f65f011b4f458e742b02727391ba => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:28.334338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.334688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.334977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.363820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.365349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77df6c5-29bf-47b4-b6cb-0589515850c7 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.367658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:28.368879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.380639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1081/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:28.382804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.383106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.383613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.442439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:28.444990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.485043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1117/2198] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:28.488336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.488336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.523345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:28.542227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1082/2199] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:28.542227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.561206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c43d4-a7e1-4f74-b5b5-241074879632 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.571164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.571906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.572294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.572579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.573448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:28.573777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.576442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8fc04-31b1-46d9-a5ac-409d397b5618 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.592691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1083/2200] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:28.592691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.592691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.592691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.613558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbe968-57e8-4d28-952f-10cc49ddc59c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.623696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.624413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.624696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.625037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.628054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.632156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:28.633473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:28.652979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1084/2201] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:28.656228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.665295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252cec-fd1a-40c6-8553-f2b157c766c4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.671311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.672115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.672402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.672779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.673642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.676402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.685439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:28.737054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1085/2202] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:28.737054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.737365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.737890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.755039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1118/2203] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:28.770021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:28.799911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8486e-c045-4446-8214-4f6360dde994 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.934288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40b8d-a170-49fb-966c-9ab79a77cae4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:28.947216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.948054 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.950131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.950622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.952084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:28.954345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.958298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.973811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:28.975931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:28.976221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:28.976501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:28.979499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:28.980347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1086/2204] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:28.984531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:28.984733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.026026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c787-d947-493c-a11f-d1ce62aec2f2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.032807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.033753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.034424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.034856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.035777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.036883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1119/2205] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:29.039345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.041851 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.078645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb704108-d780-41ad-bc3d-3f3c0f95440e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.089581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.090888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.091452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.091741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.092477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.094442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.100773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1087/2206] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:28 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:29.104895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.109453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1120/2207] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:29.113749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.138825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae798b-b3d6-4d07-b0f7-1edead75dcb6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.263690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:29.289624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.290356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8643b-2089-473e-8385-525a7d8a5de1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.290688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.291121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.291605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.292505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.294308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.296859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.297867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.298271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.299038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.299811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.303916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.312400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1121/2208] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:29.320338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.341469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbe926-ba8b-4c0a-af5c-c7000ca7c946 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.346511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1088/2209] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:29 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:29.348399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.360067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.360834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.361120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.361446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] PATH_INFO: `/v3/projects/c6e84bf071664fd9a28275ed168e8815/users/3d3b07d8c3b24ecca9f9dcb74a54dacd/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.362822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82e13d-805e-4f94-8b58-a5726b84f551 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.375063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.376967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.377724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.378436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.379978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.384029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.391499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e84bf071664fd9a28275ed168e8815, user_id=3d3b07d8c3b24ecca9f9dcb74a54dacd, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.395565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b0fd-91ed-47c2-86fb-1f776afbf629 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.407561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1089/2210] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:29.408953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.425213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1122/2211] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:29 2022] PUT /identity/v3/projects/c6e84bf071664fd9a28275ed168e8815/users/3d3b07d8c3b24ecca9f9dcb74a54dacd/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:29.427664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.428025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.428379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.433851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f62-086f-407c-b85c-6998a2bc7f1c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.512175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] MFA Rules not processed for user `3d3b07d8c3b24ecca9f9dcb74a54dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:29.513710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:29.529606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:29.594590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.595618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.595976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.596849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.597056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.598976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae080987-e6c8-4cd5-b16f-df1f3423e86d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.623769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1090/2212] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:29.625064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.625377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.625653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.665038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] MFA Rules not processed for user `5fca6a15a17c423393582da43abec450`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:29.666409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:29.699022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1123/2213] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:29.700157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.724021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94e2e-ec3a-4ba4-bf7d-bcdeec1864cb None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.733566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.738121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.738533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.738946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] PATH_INFO: `/v3/projects/6493ef52450547da823d31c2de4b110b/users/096d73d07d2b4bfda8458f46d157e520/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.759696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1091/2214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:29.766699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:29.768283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:29.775436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6493ef52450547da823d31c2de4b110b, user_id=096d73d07d2b4bfda8458f46d157e520, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:29.782558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618edc-3aa2-46a6-9d76-b9ea98588e4b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:29.811978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1124/2215] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:29 2022] PUT /identity/v3/projects/6493ef52450547da823d31c2de4b110b/users/096d73d07d2b4bfda8458f46d157e520/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:29.822837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.826703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.826997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.881695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] MFA Rules not processed for user `096d73d07d2b4bfda8458f46d157e520`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:29.883190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:29.887196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c35f1-5737-403b-99d6-752fff45f9bb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:29.972915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1125/2216] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:29.979838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:29.980829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:29.981300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:29.981875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:29.986105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:30.009289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:30.040383 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:30.053836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:30.055666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82064c24-38e1-4a8e-a539-f539a09f6155 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:30.081335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1092/2217] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:30.103023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096315-3ed5-45bb-a7d8-16b4bb78d93a None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:30.104765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72d67-7da5-4380-8436-c9da920ee2f1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:30.105278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72d67-7da5-4380-8436-c9da920ee2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:30.105631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72d67-7da5-4380-8436-c9da920ee2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:30.110288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:30.110973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:30.111253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:30.111527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:30.122718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:30.124527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:30.135581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1126/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:30.141327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-88b72d67-7da5-4380-8436-c9da920ee2f1 None None] MFA Rules not processed for user `f93fd1c9b91a4705a02229b909158004`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:30.142742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88b72d67-7da5-4380-8436-c9da920ee2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:30.182817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:30.226681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1093/2219] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:30.352749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6291b5-ad68-49f9-9c6a-a5d75e022afc service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:30.369642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:30.370416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:30.370801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:30.371178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] PATH_INFO: `/v3/users/096d73d07d2b4bfda8458f46d157e520` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:30.373284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=096d73d07d2b4bfda8458f46d157e520)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:30.375633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:30.487656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096d73d07d2b4bfda8458f46d157e520'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:30.511618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096d73d07d2b4bfda8458f46d157e520'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:30.513094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096d73d07d2b4bfda8458f46d157e520'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:30.532375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096d73d07d2b4bfda8458f46d157e520'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:30.533814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096d73d07d2b4bfda8458f46d157e520'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:30.558940 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1127/2220] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:30 2022] DELETE /identity/v3/users/096d73d07d2b4bfda8458f46d157e520 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:30.563114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:30.563611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:30.563838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:30.608152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:30.609625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:30.756705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1094/2221] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:30.779473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:30.796008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:30.955643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:31.034922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507948-1f60-4b0a-8671-a123a82a1b8a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:31.047865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:31.048501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:31.049521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:31.049816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:31.076583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:31.080677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:31.105803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1128/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:31.764125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:31.766011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:31.795917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d23a1-0b9c-43f5-9aff-e157e0c0145f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:31.815413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:31.816324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:31.816626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:31.816934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] PATH_INFO: `/v3/projects/6493ef52450547da823d31c2de4b110b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:31.818303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6493ef52450547da823d31c2de4b110b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:31.821275 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:31.935345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6493ef52450547da823d31c2de4b110b', 'request_id': 'req-fe083be2-5b84-4340-839b-ac77dba6db08'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:31.948264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6493ef52450547da823d31c2de4b110b', 'request_id': 'req-fe083be2-5b84-4340-839b-ac77dba6db08'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:31.957002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6493ef52450547da823d31c2de4b110b', 'request_id': 'req-fe083be2-5b84-4340-839b-ac77dba6db08'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:31.976894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] The token cache is being invalidate because project 6493ef52450547da823d31c2de4b110b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:31.977218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:31.978179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fe083be2-5b84-4340-839b-ac77dba6db08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:31.980049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1095/2223] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:31 2022] DELETE /identity/v3/projects/6493ef52450547da823d31c2de4b110b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:32.894608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:32.896374 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:32.915797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886b7ba-fce3-411b-a1c7-37bfa831e791 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:33.008717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:33.009106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:33.009494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:33.009862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] PATH_INFO: `/v3/users/fee1f033a0274fa3a823c639180c741a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:33.011015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee1f033a0274fa3a823c639180c741a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:33.012993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:33.085196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee1f033a0274fa3a823c639180c741a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:33.097158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee1f033a0274fa3a823c639180c741a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:33.097880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee1f033a0274fa3a823c639180c741a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:33.105194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee1f033a0274fa3a823c639180c741a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:33.105859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee1f033a0274fa3a823c639180c741a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:33.118712 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1129/2224] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:32 2022] DELETE /identity/v3/users/fee1f033a0274fa3a823c639180c741a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:33.123278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:33.123760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:33.123864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:33.149450 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:33.150729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:33.161153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:33.214170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1096/2225] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:33.224229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:33.226752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:33.314324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28c37-2a63-4492-a4f7-e91d6297852d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:33.318428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:33.319731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:33.320212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:33.320629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:33.330862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:33.332541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7793677-a135-498d-84b7-da07a9bbd176 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:33.345530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1130/2226] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:34.284964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.286733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:34.300357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ffcc-d4e3-498b-818c-0cafae8f6443 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.308618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.309483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.310163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.310551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] PATH_INFO: `/v3/projects/eca1d4d450eb40a3b1fecbb69e096158` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.316316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca1d4d450eb40a3b1fecbb69e096158)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.319009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.411397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca1d4d450eb40a3b1fecbb69e096158', 'request_id': 'req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:34.431448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca1d4d450eb40a3b1fecbb69e096158', 'request_id': 'req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:34.441733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca1d4d450eb40a3b1fecbb69e096158', 'request_id': 'req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:34.457135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] The token cache is being invalidate because project eca1d4d450eb40a3b1fecbb69e096158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:34.458387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:34.459409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1d5d7ccf-ea89-4f7e-b425-3ae69279c45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:34.462004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1097/2227] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:34 2022] DELETE /identity/v3/projects/eca1d4d450eb40a3b1fecbb69e096158 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:34.466826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.467335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.467458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.481759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:34.502744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:34.505471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:34.601498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1131/2228] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:34.603281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.603655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.603938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.626479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:34.628243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:34.637202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1098/2229] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:34.641561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.653651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060df9-5ba8-46fa-a45c-bcf760e0ad14 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.659566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.660303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.660688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.661461 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.662805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:34.663219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.665340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.696795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1132/2230] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:34.698331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.710168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbc2c5-c8f9-4e90-9901-e13a5ddfc1b5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.715620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.716704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.717604 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.718030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.719368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.723873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.764482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1099/2231] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:34 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:34.768487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.788224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6411630-bd92-451a-ac25-234b1d779f11 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.859060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.860114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.860419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.860776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.861920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.864026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.903733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1133/2232] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:34 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:34.907507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.920402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ead1-0524-4825-be9b-cb55c800a45a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.926682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.927306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.927767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.928045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.928792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.930382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.941103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1100/2233] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:34.945662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.956573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f457c50-b5c8-4ec5-a78f-737a1e068c97 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:34.962156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:34.962762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:34.963077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:34.963418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:34.963997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:34.965982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b56fad-99ec-4b69-a48d-260a05561715 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:34.980924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1134/2234] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:34.982229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:34.994115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2b0ba-7039-4807-8c7a-e6fa74709847 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:35.005755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:35.006588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:35.006946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:35.007362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] PATH_INFO: `/v3/projects/7f0c5c980cad411dac09cf81d1b7df88/users/4a2749f4a6ef40ab9e92079de31d50a3/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:35.026052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0c5c980cad411dac09cf81d1b7df88, user_id=4a2749f4a6ef40ab9e92079de31d50a3, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:35.030491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:35.048533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1101/2235] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:34 2022] PUT /identity/v3/projects/7f0c5c980cad411dac09cf81d1b7df88/users/4a2749f4a6ef40ab9e92079de31d50a3/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:35.059472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbba7d-f75d-4a2d-ba1c-4daafe753583 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:35.059926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbba7d-f75d-4a2d-ba1c-4daafe753583 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:35.060271 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbba7d-f75d-4a2d-ba1c-4daafe753583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:35.123551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8dfbba7d-f75d-4a2d-ba1c-4daafe753583 None None] MFA Rules not processed for user `4a2749f4a6ef40ab9e92079de31d50a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:35.125188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8dfbba7d-f75d-4a2d-ba1c-4daafe753583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:35.260547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:35.286922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1135/2236] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:35.295042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:35.296920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:35.358158 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:35.390915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd6c6d-f050-4000-b957-f2ce0a345d6a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:35.400031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:35.401265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:35.401265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:35.401626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:35.414970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:35.418666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:35.437262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1102/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:37.004099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9404-7401-4134-aae3-2cb79a37f6f3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:37.004581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9404-7401-4134-aae3-2cb79a37f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:37.004706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9404-7401-4134-aae3-2cb79a37f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:37.025368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-503d9404-7401-4134-aae3-2cb79a37f6f3 None None] MFA Rules not processed for user `4a2749f4a6ef40ab9e92079de31d50a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:37.026745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-503d9404-7401-4134-aae3-2cb79a37f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:37.035202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1136/2238] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:42.956239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:42.957794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:43.028546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ce818-ef80-4d24-908c-b7c75b2f84c8 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:43.032999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:43.033652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:43.033936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:43.034210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] PATH_INFO: `/v3/users/cd8b71c30c364f6c84112b73e357d508` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:43.035328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8b71c30c364f6c84112b73e357d508)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:43.037979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:43.083774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8b71c30c364f6c84112b73e357d508'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.095414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8b71c30c364f6c84112b73e357d508'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.103632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8b71c30c364f6c84112b73e357d508'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.104256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8b71c30c364f6c84112b73e357d508'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.104867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8b71c30c364f6c84112b73e357d508'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.117611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1103/2239] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:42 2022] DELETE /identity/v3/users/cd8b71c30c364f6c84112b73e357d508 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:43.122034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:43.122490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:43.122597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:43.141437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:43.142658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:43.204773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1137/2240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:43.214247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:43.215643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:43.282861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804852de-34c8-4e17-979a-033c25d3122c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:43.286616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:43.288003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:43.288288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:43.288561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:43.298579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:43.300026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:43.305782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:43.317726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1104/2241] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:43.734680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:43.736222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:43.750422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda2686-e334-4be8-9082-72217235dac0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:43.755415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:43.756746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:43.757105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:43.757516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] PATH_INFO: `/v3/projects/fe6f5da09c004291a42c942f65fe962c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:43.758783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6f5da09c004291a42c942f65fe962c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:43.760814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:43.812350 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6f5da09c004291a42c942f65fe962c', 'request_id': 'req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.818602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6f5da09c004291a42c942f65fe962c', 'request_id': 'req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.824990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6f5da09c004291a42c942f65fe962c', 'request_id': 'req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.840283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] The token cache is being invalidate because project fe6f5da09c004291a42c942f65fe962c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:43.840575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.841216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.842815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1138/2242] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:43 2022] DELETE /identity/v3/projects/fe6f5da09c004291a42c942f65fe962c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:43.846989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:43.857617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3c075-570c-48bb-ae94-38e69554f9c9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:43.922290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:43.922919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:43.923200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:43.923474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] PATH_INFO: `/v3/users/c7db6b94fa414a119489549c9924682f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:43.924592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7db6b94fa414a119489549c9924682f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:43.926603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:43.975872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7db6b94fa414a119489549c9924682f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.987926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7db6b94fa414a119489549c9924682f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.996092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7db6b94fa414a119489549c9924682f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.996723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7db6b94fa414a119489549c9924682f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:43.997355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-8b386762-af0b-45c7-b0bb-a1b5b07a2541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7db6b94fa414a119489549c9924682f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.010134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1105/2243] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:43 2022] DELETE /identity/v3/users/c7db6b94fa414a119489549c9924682f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:44.288292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.289765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:44.303382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d6fb-7ff3-4e45-a0ce-3bbd27f79d05 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.380172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.381579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.381888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.382139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] PATH_INFO: `/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.383968 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97984bcbe4fd411eb6babd4aa7bb09a9)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.386000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.403056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:44.441491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97984bcbe4fd411eb6babd4aa7bb09a9', 'request_id': 'req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.447531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97984bcbe4fd411eb6babd4aa7bb09a9', 'request_id': 'req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.453815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97984bcbe4fd411eb6babd4aa7bb09a9', 'request_id': 'req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.467318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] The token cache is being invalidate because project 97984bcbe4fd411eb6babd4aa7bb09a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:44.467537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.468205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-caa3e9e4-a6f7-449d-b5cf-813fcb16bd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:44.469858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1139/2244] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:44 2022] DELETE /identity/v3/projects/97984bcbe4fd411eb6babd4aa7bb09a9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:44.475628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.475909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.476179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.496515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:44.497845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:44.558444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1106/2245] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:44.566775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.567276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.567615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.588933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:44.590161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:44.598101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1140/2246] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:44.603010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.613069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcf85-9d52-4d44-8a4d-da56a4669565 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.619738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.620377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.620661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.620960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.621646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:44.621951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.623597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.635229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1107/2247] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:44.639818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.649450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e22a1-b8f8-45f0-875a-f7741f31ea34 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.654126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.654859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.655150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.655568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.656209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.658191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.690936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1141/2248] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:44 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:44.694904 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.706681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83339136-a458-4986-b3d6-c59ce6f2cb4a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.712006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:44.776724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.777374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.777656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.778082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.778787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.780729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.806820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1108/2249] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:44 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:44.812052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.826254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fc8bb-1055-4aa3-928c-5348c1129590 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.831551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.832273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.832660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.833034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.834563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.836283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.847296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1142/2250] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:44.851977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.867652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935623b-1ed0-4590-8529-41556b0c47cd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.874143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.875720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.876162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.876609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.877575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.879538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e43525-8dbc-4a0c-ab49-868cc99a1d42 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.895725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1109/2251] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:44.916519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:44.930133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70108-ab28-49aa-9189-06a77224829b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:44.938186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:44.939024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.939407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.939845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] PATH_INFO: `/v3/projects/4762fadb6532467f9be31e350b7ab48d/users/24a6d35beda0439aad5c5b433f260bf9/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:44.961462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4762fadb6532467f9be31e350b7ab48d, user_id=24a6d35beda0439aad5c5b433f260bf9, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:44.967669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:44.987875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1143/2252] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:44 2022] PUT /identity/v3/projects/4762fadb6532467f9be31e350b7ab48d/users/24a6d35beda0439aad5c5b433f260bf9/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:44.998727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afee96-1274-469f-9ef9-a10897161795 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:44.999255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afee96-1274-469f-9ef9-a10897161795 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:44.999255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afee96-1274-469f-9ef9-a10897161795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.069087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-09afee96-1274-469f-9ef9-a10897161795 None None] MFA Rules not processed for user `24a6d35beda0439aad5c5b433f260bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:45.075565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-09afee96-1274-469f-9ef9-a10897161795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:45.194538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1110/2253] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:45.198812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.299737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e344fe-89b3-4a3b-9a4c-7c709bdd04fc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.305202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.305858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.306148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.306426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.307066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.308980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.349615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afee96-1274-469f-9ef9-a10897161795 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.362572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1144/2254] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:45 2022] POST /identity/v3/projects => generated 401 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:45.366116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afee96-1274-469f-9ef9-a10897161795 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.512977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.517478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.518032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.519900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.520950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.523756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.576728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1111/2255] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:45 2022] POST /identity/v3/users => generated 307 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:45.580803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.599908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c071146-76f6-4402-aa75-368aafd05782 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.606406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.607256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.607607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.608016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.610188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.612710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.629443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1145/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:45.634331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.643399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:45.649921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302027-f22f-4a9f-bff8-8d620e6972e9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.659159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.660994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.662506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.663047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] PATH_INFO: `/v3/projects/e053924404234d7683f28289533f2170/users/426aab20a4854cf581f880120a4816ae/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.682085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e053924404234d7683f28289533f2170, user_id=426aab20a4854cf581f880120a4816ae, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.687795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.706639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1112/2257] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:45 2022] PUT /identity/v3/projects/e053924404234d7683f28289533f2170/users/426aab20a4854cf581f880120a4816ae/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:45.711159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.723547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186778ff-2739-412e-8dee-1d4710c696b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.740835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:45.830111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.830847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.831131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.831406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.832113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.834662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62512b20-49a8-4b01-ba03-eb719e31715d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.858764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1146/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:45.861798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:45.875771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11636d-13a7-400b-aa56-a6bd065f96c7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:45.882143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:45.883056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.883479 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.883951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] PATH_INFO: `/v3/projects/e053924404234d7683f28289533f2170/users/426aab20a4854cf581f880120a4816ae/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.886169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e053924404234d7683f28289533f2170, user_id=426aab20a4854cf581f880120a4816ae, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:45.889443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:45.902211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1113/2259] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:45 2022] PUT /identity/v3/projects/e053924404234d7683f28289533f2170/users/426aab20a4854cf581f880120a4816ae/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:45.916119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:45.916410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:45.916693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:45.955605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] MFA Rules not processed for user `426aab20a4854cf581f880120a4816ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:45.956636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:46.036275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1147/2260] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:46.048854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:46.051184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:46.144080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091a79-910a-4f18-9f56-ef87d890a361 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:46.149752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:46.150414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:46.151190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:46.151190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:46.160673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:46.162186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:46.173417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1114/2261] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:46.287761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:46.289193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:46.306342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7299b1-ef76-420e-a3b5-4f9fe9a223b3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:46.310714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:46.311337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:46.311620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:46.311899 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:46.378011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:46.379501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151ab75-bb8c-41c5-bdbf-734749395fe8 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:46.389678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1148/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:48.860987 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:48.863015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:48.937249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8ab4d-663d-4d61-99c1-818ae89bb2b3 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:48.941751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:48.942408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:48.942633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:48.943652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] PATH_INFO: `/v3/users/3d3b07d8c3b24ecca9f9dcb74a54dacd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:48.944727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3b07d8c3b24ecca9f9dcb74a54dacd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:48.946631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:48.992676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3b07d8c3b24ecca9f9dcb74a54dacd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.005190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3b07d8c3b24ecca9f9dcb74a54dacd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.014652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3b07d8c3b24ecca9f9dcb74a54dacd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.015344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3b07d8c3b24ecca9f9dcb74a54dacd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.016000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3b07d8c3b24ecca9f9dcb74a54dacd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.017448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:49.030527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1115/2263] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:48 2022] DELETE /identity/v3/users/3d3b07d8c3b24ecca9f9dcb74a54dacd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:49.035152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.035634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.035731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.055731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:49.056952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:49.087698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:49.118875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1149/2264] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:49.128469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.130411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:49.187747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaab84-89fa-4b43-b299-48af8ef20ccc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.191456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.192056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.192342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.192612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.201557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.202928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9045d-dc83-4c69-b6e8-62541301291a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.212221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1116/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:49.484614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.486361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:49.499033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc6f0e-616e-470e-9af1-e0782eb7ac70 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.504567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.504711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.505336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.505614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] PATH_INFO: `/v3/projects/c6e84bf071664fd9a28275ed168e8815` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.507081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e84bf071664fd9a28275ed168e8815)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.508985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.560759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e84bf071664fd9a28275ed168e8815', 'request_id': 'req-f242f8fe-45f7-49d0-a3d2-a9256bef6977'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.566885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e84bf071664fd9a28275ed168e8815', 'request_id': 'req-f242f8fe-45f7-49d0-a3d2-a9256bef6977'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.574309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e84bf071664fd9a28275ed168e8815', 'request_id': 'req-f242f8fe-45f7-49d0-a3d2-a9256bef6977'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.590407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] The token cache is being invalidate because project c6e84bf071664fd9a28275ed168e8815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:49.590704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.591361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f242f8fe-45f7-49d0-a3d2-a9256bef6977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:49.592856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1150/2266] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:49 2022] DELETE /identity/v3/projects/c6e84bf071664fd9a28275ed168e8815 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:49.597800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.598091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.598366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.619750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:49.621190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:49.685421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1117/2267] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:49.693597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.693885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.694163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.716701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:49.719063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:49.730649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1151/2268] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:49.735507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.749180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aa274-c36e-4c56-9b67-13108bed4939 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.755615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.756332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.756660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.757001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.757842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:49.758208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.760114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.774106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1118/2269] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:12:49.778613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.789105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137c49f-10d4-4261-ad61-53a50286b3f3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.794328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.794996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.796144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.796424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.797139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.799064 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.829243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1152/2270] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:49 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:49.833207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.844414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a6f2-2fdb-4853-a9d7-6afd516bc673 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.915730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.916318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.916595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.916868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.917554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.919446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.939597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1119/2271] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:49 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:49.944334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.954516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbbf7-973e-4916-afd9-0a5f9ce5cd43 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.959750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.960362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.960632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.960927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.961709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.963308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.973289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1153/2272] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:49.977594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:49.987575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113996-e72f-40c8-84f1-bb74e6b24de7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:49.992638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:49.993326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:49.993677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:49.994016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:49.994749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:49.996465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17893862-382a-43e4-9847-2f9daecf85b8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:49.998692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:50.009758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1120/2273] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:50.013895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.024442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3af42-cf86-4522-891c-c6792a3b13bd admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.029088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.029749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.030030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.030296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] PATH_INFO: `/v3/projects/a51ae72027054d29b7ee25777195c352/users/314f0ec90be341f3a4d7c137f63e367c/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.045214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51ae72027054d29b7ee25777195c352, user_id=314f0ec90be341f3a4d7c137f63e367c, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.047954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.061721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1154/2274] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:50 2022] PUT /identity/v3/projects/a51ae72027054d29b7ee25777195c352/users/314f0ec90be341f3a4d7c137f63e367c/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:50.073189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.073548 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.073827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.102739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] MFA Rules not processed for user `314f0ec90be341f3a4d7c137f63e367c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:50.103943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:50.169693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1121/2275] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:50.174289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.231398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:50.237610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ba55-3e89-4edf-acf7-eb32eb7c6ca6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.243923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.244535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.244812 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.245091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.245757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.247682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.275218 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1155/2276] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:50.279597 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.290858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90fc3-66c1-40e1-a8c3-b8a367b39f97 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.347380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.347995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.348279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.348555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.349199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.351167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.375289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1122/2277] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:50.376434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.387191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6e8a8-3f24-4a06-b1c3-2d821eabeab3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.391830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.392425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.392709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.392984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.393667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.395282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.405780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1156/2278] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:50.409825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.419590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae23b7-7ccf-4d6e-b363-918227a2a7b7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.424115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.424693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.424971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.425271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.425909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.428011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d411d-466d-49b6-84a9-66023d206ef1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.437838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1123/2279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:50.441465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.451729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edebad-380e-4d49-a000-e53f067c0419 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.456292 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.456930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.457212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.457520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] PATH_INFO: `/v3/projects/3c34f0971d2b41f8a17518885c37427b/users/2c33ef3a0c434ce2a8c8c47d949ffc0a/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.471706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c34f0971d2b41f8a17518885c37427b, user_id=2c33ef3a0c434ce2a8c8c47d949ffc0a, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.474930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.487641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1157/2280] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:50 2022] PUT /identity/v3/projects/3c34f0971d2b41f8a17518885c37427b/users/2c33ef3a0c434ce2a8c8c47d949ffc0a/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:50.499542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.499837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.500118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.527170 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] MFA Rules not processed for user `2c33ef3a0c434ce2a8c8c47d949ffc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:50.528373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:50.584944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:50.597364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1124/2281] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:50.598610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.662682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05181b6-dfc3-40fc-985b-c5b11961df61 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.667735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.668738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.668738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.668945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.669619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.671524 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.699203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1158/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:50.703182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.715257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591a160-d075-4599-9987-bbeae78e9f6b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.778192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.778817 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.779103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.779382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.780034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.782129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.825067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1125/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:50 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:50.826408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.846155 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b8c0-001e-4d1e-be6e-f95ff555e0d1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.848087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.851250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:50.853952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.854596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.854875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.855147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.855796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.857475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.864340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1a6e8-2b31-4f14-9b5a-50088bf6e19c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.869837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.870933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.871152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.871532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] PATH_INFO: `/v3/users/24a6d35beda0439aad5c5b433f260bf9` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.872605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1159/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:50.872980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a6d35beda0439aad5c5b433f260bf9)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.876389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.876943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.888995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f28ad2-77d2-491e-b4f8-1c76f801d6d3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:50.894075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:50.894732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:50.895010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:50.895285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] PATH_INFO: `/v3/projects/3b13cc58dd224272a579b027f2ba3df2/users/d87c33f798d540ebb411378a08fd1a2d/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:50.918893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b13cc58dd224272a579b027f2ba3df2, user_id=d87c33f798d540ebb411378a08fd1a2d, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:50.921679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:50.945009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1160/2285] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:50 2022] PUT /identity/v3/projects/3b13cc58dd224272a579b027f2ba3df2/users/d87c33f798d540ebb411378a08fd1a2d/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:50.946769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:50.952922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a6d35beda0439aad5c5b433f260bf9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:50.981298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a6d35beda0439aad5c5b433f260bf9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:50.994324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a6d35beda0439aad5c5b433f260bf9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:50.998365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a6d35beda0439aad5c5b433f260bf9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:50.999203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a8196ced-2b46-423f-b87b-a7b345970e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a6d35beda0439aad5c5b433f260bf9'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:51.017981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1126/2286] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:50 2022] DELETE /identity/v3/users/24a6d35beda0439aad5c5b433f260bf9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:51.024142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:51.025573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.025819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.026030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.040183 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ab84-77aa-4986-b0f2-f9772ec5510c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:51.047006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:51.048519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.129343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:51.151905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:51.152520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.152804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.153084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.153944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:51.155557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:51.165097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1127/2287] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:51.177365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:51.178995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.180283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1161/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:51.186665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:51.188409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.202538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16763f5-4ed2-4d26-9577-e1868fa30346 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:51.207729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:51.208462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.209385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.209983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] PATH_INFO: `/v3/projects/3b13cc58dd224272a579b027f2ba3df2/users/d87c33f798d540ebb411378a08fd1a2d/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.212023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b13cc58dd224272a579b027f2ba3df2, user_id=d87c33f798d540ebb411378a08fd1a2d, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:51.214806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c5503-fb79-4361-b156-01322c61033c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:51.227788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1162/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:51 2022] PUT /identity/v3/projects/3b13cc58dd224272a579b027f2ba3df2/users/d87c33f798d540ebb411378a08fd1a2d/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:51.239191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.239479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.240328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.274166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc33aab-1231-406b-a079-bd2f47567152 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:51.300768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] MFA Rules not processed for user `d87c33f798d540ebb411378a08fd1a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:51.305616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.427209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:51.427839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.428125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.428401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.471946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1163/2290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:51.480298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:51.482004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.550050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:51.551856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:51.565176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1128/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:51.567087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7592f5-a95a-48e6-a468-39fdf03b6db7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:51.571531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:51.572200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.572473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.572749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.574533 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.609031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:51.681130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:51.682995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:51.706789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1164/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:51.918163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:51.919793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:51.933591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d94c4e-83ae-4179-b185-d710735f5215 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:51.938433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:51.939208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:51.939588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:51.939961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] PATH_INFO: `/v3/projects/4762fadb6532467f9be31e350b7ab48d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:51.941422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4762fadb6532467f9be31e350b7ab48d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:51.944057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:52.002473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4762fadb6532467f9be31e350b7ab48d', 'request_id': 'req-48de7d35-c3d8-434c-9391-e214c75ed7f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.014404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4762fadb6532467f9be31e350b7ab48d', 'request_id': 'req-48de7d35-c3d8-434c-9391-e214c75ed7f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.016803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:52.021857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4762fadb6532467f9be31e350b7ab48d', 'request_id': 'req-48de7d35-c3d8-434c-9391-e214c75ed7f1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.035696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] The token cache is being invalidate because project 4762fadb6532467f9be31e350b7ab48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:52.037125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.038085 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.039764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1129/2293] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:51 2022] DELETE /identity/v3/projects/4762fadb6532467f9be31e350b7ab48d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:52.043763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:52.054768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9794-b69d-4256-8de9-1c61b0073ad0 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:52.118483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:52.118912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.119191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.119478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] PATH_INFO: `/v3/users/426aab20a4854cf581f880120a4816ae` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.120570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=426aab20a4854cf581f880120a4816ae)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:52.122529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:52.168802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426aab20a4854cf581f880120a4816ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.180253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426aab20a4854cf581f880120a4816ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.180913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426aab20a4854cf581f880120a4816ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.187405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426aab20a4854cf581f880120a4816ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.188085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ac26eacd-4609-475a-85e6-7092d97c45fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426aab20a4854cf581f880120a4816ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.201858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1165/2294] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:52 2022] DELETE /identity/v3/users/426aab20a4854cf581f880120a4816ae => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:52.581757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:52.583633 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:52.598934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7d35-c3d8-434c-9391-e214c75ed7f1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:52.657031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:52.657730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.658012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.658286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] PATH_INFO: `/v3/projects/e053924404234d7683f28289533f2170` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.659417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e053924404234d7683f28289533f2170)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:52.661948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:52.712806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e053924404234d7683f28289533f2170', 'request_id': 'req-7865113d-2c79-44dd-a510-dc00cf8e4c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.725178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e053924404234d7683f28289533f2170', 'request_id': 'req-7865113d-2c79-44dd-a510-dc00cf8e4c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.732475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e053924404234d7683f28289533f2170', 'request_id': 'req-7865113d-2c79-44dd-a510-dc00cf8e4c53'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.753392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] The token cache is being invalidate because project e053924404234d7683f28289533f2170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:52.753500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.754498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7865113d-2c79-44dd-a510-dc00cf8e4c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:52.756438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1130/2295] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:52 2022] DELETE /identity/v3/projects/e053924404234d7683f28289533f2170 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:52.761275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.761487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.761830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.809250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:52.809250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:52.856414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:52.882718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1166/2296] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:52.890487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.890854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.891250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.925021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:52.926255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:52.936200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1131/2297] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:52.941483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:52.951902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fec4c-80a5-43c2-9524-a10d5d39fbac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:52.956614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:52.957259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.957618 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.957894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.958583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:52.958887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:52.960528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:52.972788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1167/2298] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:12:52.977828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:52.987176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a831f-b2c9-4f5a-85b4-58959658885f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:52.993000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:52.993630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:52.993908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:52.994178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:52.995465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:52.996706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.025589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1132/2299] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:53.029769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.040161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ef7f-4de8-46fe-ad99-95fd4a665d00 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.105262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.105894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.106163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.106441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.107087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.109034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.134342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1168/2300] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:53 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:53.139141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.151389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70468e-4d0f-4fb8-804b-1c865f0fc548 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.160729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.161414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.162471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.162799 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.163484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.165156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.181791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1133/2301] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:53.184006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.194862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4f246-89a8-4467-909a-fbbeda539123 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.200397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.201092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.201463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.201801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.202516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.204519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b62376-b58a-4c4c-b92d-945e373630be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.220415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1169/2302] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:53.221683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.235014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c395c7-94db-44fa-838a-5f1b4c254d52 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.257838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.258523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.258804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.259082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] PATH_INFO: `/v3/projects/cabb049f3f96433bbdce2da0d6e2fa5e/users/bfcb75076b1a4dc0a06bcccae358802c/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.285437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabb049f3f96433bbdce2da0d6e2fa5e, user_id=bfcb75076b1a4dc0a06bcccae358802c, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.285437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.297578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1134/2303] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:53 2022] PUT /identity/v3/projects/cabb049f3f96433bbdce2da0d6e2fa5e/users/bfcb75076b1a4dc0a06bcccae358802c/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:53.309336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.309610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.309888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.352476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.354427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:53.355145 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] MFA Rules not processed for user `bfcb75076b1a4dc0a06bcccae358802c`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:53.356621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:53.370866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:53.438246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b5b-aad0-4a6c-b9b9-960c7ea43f75 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.439813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1170/2304] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:53.444737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.444906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.445595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.445875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.446247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.449007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:53.504684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:53.520182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.522661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.532158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a869c9-d6fd-484a-92ce-47686a2a7662 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.538143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1135/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:12:53.540208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.541032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.541311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.541573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.542486 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.544863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.579599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1171/2306] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:53 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:53.580741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.593675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66abed-88d0-46e1-aa1b-267fd70473a0 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.712476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.713256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.713829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.713976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.714625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.718032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.764689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1136/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:53 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:53.775211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.790979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ddb1b-af6e-42a0-a5e1-07729f4a2ced admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.799648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.800511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.813783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.814377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.818951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.834054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.868786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1172/2308] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:53.871658 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:53.890159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299da167-511b-4f62-b0e4-851d2b92f41e admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:53.910469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:53.911715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:53.912215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:53.912783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] PATH_INFO: `/v3/projects/aa8ebf9592364458bd99be7db8c6ce00/users/d5f0da7d3fc34bd09a314917c650a941/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:53.953803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ebf9592364458bd99be7db8c6ce00, user_id=d5f0da7d3fc34bd09a314917c650a941, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:53.958978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:53.991306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1137/2309] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:53 2022] PUT /identity/v3/projects/aa8ebf9592364458bd99be7db8c6ce00/users/d5f0da7d3fc34bd09a314917c650a941/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:53.995288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:54.006528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb0690-98d6-4a73-b45a-ca8c547e7a1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:54.080366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:54.081045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.081363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.081807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.082509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:54.084384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a815-c010-497e-9507-2c9bf09777b1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:54.100536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1173/2310] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:54.105038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:54.118154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afe6f3-8919-4590-9090-90ea1819296f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:54.123923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:54.124584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.124930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.125435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] PATH_INFO: `/v3/projects/aa8ebf9592364458bd99be7db8c6ce00/users/d5f0da7d3fc34bd09a314917c650a941/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.127456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ebf9592364458bd99be7db8c6ce00, user_id=d5f0da7d3fc34bd09a314917c650a941, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:54.130752 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:54.143786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1138/2311] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:54 2022] PUT /identity/v3/projects/aa8ebf9592364458bd99be7db8c6ce00/users/d5f0da7d3fc34bd09a314917c650a941/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:54.154678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.154985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.155284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.184964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] MFA Rules not processed for user `d5f0da7d3fc34bd09a314917c650a941`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:54.186596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:54.265482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1174/2312] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:54.280998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:54.283349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:54.312166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:54.351490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72d539-cd61-4bc6-8ceb-5dcdf5d879d2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:54.355245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:54.355848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.356130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.356408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.366694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:54.368370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e8737-56e7-49f6-9741-ced756760990 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:54.377979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1139/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:54.462219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:54.472487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93805ca-37cd-4191-8bd2-e65faaa12780 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:54.476789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:54.477433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.477714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.478114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.480247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:54.530023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:54.580283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:54.581866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:54.594154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1175/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:54.889946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d84f6-56e0-4a54-ad15-057874da1092 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:54.890156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d84f6-56e0-4a54-ad15-057874da1092 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:54.890330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d84f6-56e0-4a54-ad15-057874da1092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:54.915072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-304d84f6-56e0-4a54-ad15-057874da1092 None None] MFA Rules not processed for user `f93fd1c9b91a4705a02229b909158004`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:54.916353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-304d84f6-56e0-4a54-ad15-057874da1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:54.990257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1140/2315] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:55.038936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:55.100451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dc41-9f64-43f0-8509-fbb0f6930757 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:55.111802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:55.112509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.112794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.113073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] PATH_INFO: `/v3/users/bfcb75076b1a4dc0a06bcccae358802c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.115358 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcb75076b1a4dc0a06bcccae358802c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:55.117743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:55.174409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcb75076b1a4dc0a06bcccae358802c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.189995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcb75076b1a4dc0a06bcccae358802c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.190977 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcb75076b1a4dc0a06bcccae358802c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.200912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcb75076b1a4dc0a06bcccae358802c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.201694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcb75076b1a4dc0a06bcccae358802c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.215290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1176/2316] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:55 2022] DELETE /identity/v3/users/bfcb75076b1a4dc0a06bcccae358802c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:55.219792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b6e3-3b7a-4cb0-93b5-2e3219990bd7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.220286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b6e3-3b7a-4cb0-93b5-2e3219990bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.220546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b6e3-3b7a-4cb0-93b5-2e3219990bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.241332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3509b6e3-3b7a-4cb0-93b5-2e3219990bd7 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:55.243082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3509b6e3-3b7a-4cb0-93b5-2e3219990bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:55.322432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1141/2317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:55.331929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:55.334121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:55.403761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:55.408591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912c6e-cb48-4f26-a4a3-5cc9595dd564 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:55.416057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:55.416927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.417635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.417979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.429753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:55.431219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:55.441542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1177/2318] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:55.479380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.479813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.480157 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.506894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:55.508232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:55.578233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1142/2319] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:55.637683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:55.639148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:55.754425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cee126-026d-459e-8dc2-91e9adfceb13 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:55.761318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:55.761929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.762209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.762479 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.778775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:55.780538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:55.798816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1178/2320] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:55.839163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:55.840666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:55.878801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abeea8-af80-4357-8e6c-9ef1eca7336e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:55.890766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:55.892030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:55.892944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:55.893419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] PATH_INFO: `/v3/projects/cabb049f3f96433bbdce2da0d6e2fa5e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:55.895113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabb049f3f96433bbdce2da0d6e2fa5e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:55.897671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:55.926228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:55.983341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabb049f3f96433bbdce2da0d6e2fa5e', 'request_id': 'req-6fa5abfd-4be3-4d23-b9b2-431235058059'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:55.992199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabb049f3f96433bbdce2da0d6e2fa5e', 'request_id': 'req-6fa5abfd-4be3-4d23-b9b2-431235058059'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.001328 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabb049f3f96433bbdce2da0d6e2fa5e', 'request_id': 'req-6fa5abfd-4be3-4d23-b9b2-431235058059'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.028549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] The token cache is being invalidate because project cabb049f3f96433bbdce2da0d6e2fa5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:56.028819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.029699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-6fa5abfd-4be3-4d23-b9b2-431235058059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.031465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1143/2321] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:55 2022] DELETE /identity/v3/projects/cabb049f3f96433bbdce2da0d6e2fa5e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:56.035994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:56.050326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa8b0c-f337-48e3-ae6b-734c5e8a684c service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:56.195742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:56.196400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:56.196688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:56.196965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] PATH_INFO: `/v3/users/d5f0da7d3fc34bd09a314917c650a941` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:56.199948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f0da7d3fc34bd09a314917c650a941)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:56.203061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:56.299425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f0da7d3fc34bd09a314917c650a941'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.314226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f0da7d3fc34bd09a314917c650a941'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.315050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f0da7d3fc34bd09a314917c650a941'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.324894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f0da7d3fc34bd09a314917c650a941'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.325787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f0da7d3fc34bd09a314917c650a941'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.336086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:56.345820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1179/2322] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:56 2022] DELETE /identity/v3/users/d5f0da7d3fc34bd09a314917c650a941 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:56.565375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:56.565375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:56.565375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:56.575481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:56.576712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:56.642966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1144/2323] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:56.656671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:56.658238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:56.739162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0887b-7025-465e-bffc-111291b28fc5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:56.750642 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:56.751275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:56.751557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:56.751829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:56.763149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:56.764602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:56.776200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:56.777987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf4181-2c6f-43c9-9fb9-0d10b3c48a1d service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:56.796360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1180/2324] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:12:56.867937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe63a-c172-4f26-b5ca-b51cc61dd567 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:56.873544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:56.874279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:56.874625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:56.874966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] PATH_INFO: `/v3/projects/aa8ebf9592364458bd99be7db8c6ce00` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:56.876155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8ebf9592364458bd99be7db8c6ce00)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:56.878407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:56.944924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:56.950828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8ebf9592364458bd99be7db8c6ce00', 'request_id': 'req-3c153dbd-47ac-47f0-9973-b30bef92da70'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.963360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8ebf9592364458bd99be7db8c6ce00', 'request_id': 'req-3c153dbd-47ac-47f0-9973-b30bef92da70'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.969911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8ebf9592364458bd99be7db8c6ce00', 'request_id': 'req-3c153dbd-47ac-47f0-9973-b30bef92da70'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.983232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] The token cache is being invalidate because project aa8ebf9592364458bd99be7db8c6ce00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:56.983519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.984357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3c153dbd-47ac-47f0-9973-b30bef92da70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:56.985919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1145/2325] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:56 2022] DELETE /identity/v3/projects/aa8ebf9592364458bd99be7db8c6ce00 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:56.992600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a977e-7136-4282-98b9-28739d073851 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:56.993164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a977e-7136-4282-98b9-28739d073851 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:56.993648 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a977e-7136-4282-98b9-28739d073851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.019279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0f2a977e-7136-4282-98b9-28739d073851 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:57.020645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0f2a977e-7136-4282-98b9-28739d073851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:57.084401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.084622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1181/2326] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:57.084760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.085027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.092257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.092757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.093039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.105294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:57.106781 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:57.113348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:57.115068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:57.126030 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1182/2327] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:57.131125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.144290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a758c-f863-43cd-8dce-009a3ee08c9c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.150022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.150743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.151101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.151445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.152224 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:12:57.152595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.155230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.168273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1183/2328] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:12:57.173450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.183685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1146/2329] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:57.187377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29220d-e8fa-4fba-a5e1-bff5de12c0d0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.192187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.193611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.194007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.194365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.195288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.197504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.202124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.203914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:57.241691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1184/2330] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:57.246434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.302638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75075b-bcf6-4262-905f-937a72b994eb None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.355009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:57.409490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148256-ab36-42c2-9f86-3cbe7d2333e3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.427535 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.428319 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.428549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.428877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.429443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.430200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.430709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.431024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.444009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.447678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.475774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:57.502005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1185/2331] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:57.507365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.520720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79bd09-0765-4791-b9dc-7740caf5898d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.526905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.527781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.528256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.528630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.529416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.535237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.537782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.539452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.548750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1147/2332] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:12:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 14:12:57.566279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1186/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:57.581755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.595505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722afe94-33d2-4d7d-af5e-d198cbdd6d21 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.604340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.605523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.605523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.605523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.606268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.608064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469da42-1f06-432d-984a-fc5c5d046e6f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.627955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1148/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:12:57.632339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.645516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd5850-9e8c-40f1-bc0f-8064e2e10392 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.651888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.652734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.652966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.653274 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] PATH_INFO: `/v3/projects/cb6a3bfcb1de4e8ba5f52bf5965c3620/users/b092710ebd604907aafcd0945582f49a/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.674335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6a3bfcb1de4e8ba5f52bf5965c3620, user_id=b092710ebd604907aafcd0945582f49a, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.678541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:57.696775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1187/2335] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:57 2022] PUT /identity/v3/projects/cb6a3bfcb1de4e8ba5f52bf5965c3620/users/b092710ebd604907aafcd0945582f49a/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:57.707661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.707986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.708811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.757437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] MFA Rules not processed for user `b092710ebd604907aafcd0945582f49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:57.762154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:57.855027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1149/2336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:57.859690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:57.946615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9109-5d82-4753-afc7-c114d4ae0aec admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:57.952355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:57.954755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:57.955328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:57.955774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:57.956578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:57.959446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a85358-5aaa-4591-9476-12d537a07aef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.000528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1188/2337] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:12:57 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:12:58.006217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.019506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef2271-5430-48e5-ab13-6bee7bfeeb02 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.076743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.077113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.077501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.095689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.096674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.096928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.097309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.098109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.100210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:58.100890 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.101477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:58.127260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1150/2338] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:12:58 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:12:58.131215 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.141385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804760c-65c5-4638-a6f8-672afa7802b7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.146445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.147050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.147331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.147646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.148427 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.150108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.161763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1151/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:58.165804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.170272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1189/2340] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:12:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:58.180331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5f9ed-7a43-4fbe-b34f-bb3426267f40 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.185201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.193152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.193853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.194252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.194632 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] PATH_INFO: `/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3/users/44080ca8fa0e4a20af84e16dfc3889f8/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.211794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4b31ad2d2647c1a97cf2b5503740e3, user_id=44080ca8fa0e4a20af84e16dfc3889f8, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.215311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.217808 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:58.229033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:58.233954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1152/2341] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:58 2022] PUT /identity/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3/users/44080ca8fa0e4a20af84e16dfc3889f8/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:58.237497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.270730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f5ce-6fc5-4e91-98a5-6db14df397d1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.309476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cab7d-f9cf-4898-87d1-3d5e2d7c5d56 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.314745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.315314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.315598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.315857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.316500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.318354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.328750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1153/2342] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:12:58.332551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.334601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.335658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.335658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.335873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.344173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237db7-4d7e-48ec-a48d-a64c8e773119 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.350183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.351879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.351879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.351879 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] PATH_INFO: `/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3/users/44080ca8fa0e4a20af84e16dfc3889f8/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.358092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4b31ad2d2647c1a97cf2b5503740e3, user_id=44080ca8fa0e4a20af84e16dfc3889f8, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.360957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4025-9b01-47ce-bd5a-1928d0e957f5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.373314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1154/2343] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:12:58 2022] PUT /identity/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3/users/44080ca8fa0e4a20af84e16dfc3889f8/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:12:58.382916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.383400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.383837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.404884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.406532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.416025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1190/2344] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:12:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 14:12:58.416397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] MFA Rules not processed for user `44080ca8fa0e4a20af84e16dfc3889f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:58.418005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:58.501973 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1155/2345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:12:58.513785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.515413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:58.584777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2e210-ca82-4c07-8b20-a03a320aeff3 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:58.656275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:58.683020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:58.683732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:58.684080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:58.684424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:58.763096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:58.764561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f35df-bb81-486e-9430-04df3db539d7 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:58.779381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1191/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:58.949517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:58.952124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:59.095116 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147978-a4e3-4d3d-bc69-54ce7cecd34b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:59.104422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:59.105196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:59.105829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:59.105829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] PATH_INFO: `/v3/users/314f0ec90be341f3a4d7c137f63e367c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:59.107076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314f0ec90be341f3a4d7c137f63e367c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:59.109265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:59.121595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:12:59.231441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314f0ec90be341f3a4d7c137f63e367c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.255505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314f0ec90be341f3a4d7c137f63e367c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.272149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314f0ec90be341f3a4d7c137f63e367c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.272990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314f0ec90be341f3a4d7c137f63e367c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.273724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314f0ec90be341f3a4d7c137f63e367c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.309836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1156/2347] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:58 2022] DELETE /identity/v3/users/314f0ec90be341f3a4d7c137f63e367c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:59.311333 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:59.311838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:59.311951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:59.337175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:12:59.338502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:59.414690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1192/2348] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:12:59.424262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:59.426465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:59.503850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5467535-2ce1-4a4d-a84b-5c0f2fc89175 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:59.508553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:59.509155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:59.509464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:59.509789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:59.521903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:59.523330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:59.533961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1157/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:12:59.829966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:59.832004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:12:59.846475 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d33e3b-b8ea-4a13-af30-0084e1bd09b9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:12:59.852257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:12:59.853198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:12:59.853512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:12:59.853814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] PATH_INFO: `/v3/projects/a51ae72027054d29b7ee25777195c352` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:12:59.855011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51ae72027054d29b7ee25777195c352)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:12:59.856877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:12:59.904650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51ae72027054d29b7ee25777195c352', 'request_id': 'req-e5e488ee-e444-4634-928c-363bc50b2137'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.910174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51ae72027054d29b7ee25777195c352', 'request_id': 'req-e5e488ee-e444-4634-928c-363bc50b2137'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.916921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51ae72027054d29b7ee25777195c352', 'request_id': 'req-e5e488ee-e444-4634-928c-363bc50b2137'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.929100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] The token cache is being invalidate because project a51ae72027054d29b7ee25777195c352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:12:59.929423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.930112 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:12:59.932200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1193/2350] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:12:59 2022] DELETE /identity/v3/projects/a51ae72027054d29b7ee25777195c352 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:12:59.935923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:12:59.946011 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10e57c-0285-4537-89aa-6adbe4dadca6 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:00.008629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:00.009436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:00.009582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:00.009868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] PATH_INFO: `/v3/users/2c33ef3a0c434ce2a8c8c47d949ffc0a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:00.011004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c33ef3a0c434ce2a8c8c47d949ffc0a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:00.012958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:00.043471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:00.064219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c33ef3a0c434ce2a8c8c47d949ffc0a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.076533 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c33ef3a0c434ce2a8c8c47d949ffc0a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.084888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c33ef3a0c434ce2a8c8c47d949ffc0a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.085536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c33ef3a0c434ce2a8c8c47d949ffc0a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.086150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c33ef3a0c434ce2a8c8c47d949ffc0a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.098402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1158/2351] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:12:59 2022] DELETE /identity/v3/users/2c33ef3a0c434ce2a8c8c47d949ffc0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:00.459373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:00.462220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:00.476572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e488ee-e444-4634-928c-363bc50b2137 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:00.492332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:00.556377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:00.557065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:00.557382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:00.557659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] PATH_INFO: `/v3/projects/3c34f0971d2b41f8a17518885c37427b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:00.558874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c34f0971d2b41f8a17518885c37427b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:00.560957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:00.612937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c34f0971d2b41f8a17518885c37427b', 'request_id': 'req-723494ec-a161-4063-a325-6bd1f069b320'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.621024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c34f0971d2b41f8a17518885c37427b', 'request_id': 'req-723494ec-a161-4063-a325-6bd1f069b320'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.633560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c34f0971d2b41f8a17518885c37427b', 'request_id': 'req-723494ec-a161-4063-a325-6bd1f069b320'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.646095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] The token cache is being invalidate because project 3c34f0971d2b41f8a17518885c37427b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:00.646445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.647448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.648872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1194/2352] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:00 2022] DELETE /identity/v3/projects/3c34f0971d2b41f8a17518885c37427b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:00.652983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:00.654519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:00.667991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b9a3-c073-4db3-8239-1bf1ec9e2bec admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:00.727579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:00.728216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:00.729336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:00.729630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] PATH_INFO: `/v3/users/d87c33f798d540ebb411378a08fd1a2d` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:00.730927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87c33f798d540ebb411378a08fd1a2d)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:00.732961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:00.792181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87c33f798d540ebb411378a08fd1a2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.805044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87c33f798d540ebb411378a08fd1a2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.812269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87c33f798d540ebb411378a08fd1a2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.812873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87c33f798d540ebb411378a08fd1a2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.813498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0545db5d-41d4-47da-aeef-72ed80b10700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87c33f798d540ebb411378a08fd1a2d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:00.825458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1159/2353] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:00 2022] DELETE /identity/v3/users/d87c33f798d540ebb411378a08fd1a2d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:00.860908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:00.862385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:00.876005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723494ec-a161-4063-a325-6bd1f069b320 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:00.941473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:00.943191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:00.943191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:00.943191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] PATH_INFO: `/v3/users/4a2749f4a6ef40ab9e92079de31d50a3` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:00.944317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2749f4a6ef40ab9e92079de31d50a3)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:00.946388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.014040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:01.016909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2749f4a6ef40ab9e92079de31d50a3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.031141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2749f4a6ef40ab9e92079de31d50a3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.031848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2749f4a6ef40ab9e92079de31d50a3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.038557 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2749f4a6ef40ab9e92079de31d50a3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.039282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2749f4a6ef40ab9e92079de31d50a3'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.052534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1195/2354] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:00 2022] DELETE /identity/v3/users/4a2749f4a6ef40ab9e92079de31d50a3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:01.057143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.057659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.057921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.077731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.079023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.096320 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:01.145567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1160/2355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:01.155813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.157392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.219662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2a8c-58c6-4206-944c-268c4281a8b5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.224065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.224750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.225103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.225471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.235716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.237777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b73193-3974-42ba-9274-3675830e0342 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.253407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1196/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:01.279269 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.280798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.294465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d918-c6b4-46a7-bdb4-8ce705a5dea0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.301377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.305132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.305132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.305132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] PATH_INFO: `/v3/projects/3b13cc58dd224272a579b027f2ba3df2` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.306166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b13cc58dd224272a579b027f2ba3df2)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.309994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.383317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b13cc58dd224272a579b027f2ba3df2', 'request_id': 'req-b143b716-1a41-425c-b97a-5ca1ab5fad11'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.392372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b13cc58dd224272a579b027f2ba3df2', 'request_id': 'req-b143b716-1a41-425c-b97a-5ca1ab5fad11'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.412713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b13cc58dd224272a579b027f2ba3df2', 'request_id': 'req-b143b716-1a41-425c-b97a-5ca1ab5fad11'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.426748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] The token cache is being invalidate because project 3b13cc58dd224272a579b027f2ba3df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:01.427035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.428174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.433245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1161/2357] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:01 2022] DELETE /identity/v3/projects/3b13cc58dd224272a579b027f2ba3df2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:01.436503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.436798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.437688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.461244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.480220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.487923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.492131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.593839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1197/2358] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:01.594900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.597102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.606878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b716-1a41-425c-b97a-5ca1ab5fad11 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.613736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.614432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.614769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.615049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] PATH_INFO: `/v3/projects/7f0c5c980cad411dac09cf81d1b7df88` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.616184 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0c5c980cad411dac09cf81d1b7df88)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.616820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe45f50-c2cc-4454-bc6c-5b6b770dac53 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.618454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.623351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.624290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.624796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.625307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] PATH_INFO: `/v3/users/b092710ebd604907aafcd0945582f49a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.626732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b092710ebd604907aafcd0945582f49a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.629637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.701140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b092710ebd604907aafcd0945582f49a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.714442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:01.721803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b092710ebd604907aafcd0945582f49a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.722517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b092710ebd604907aafcd0945582f49a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.725869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:01.728675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0c5c980cad411dac09cf81d1b7df88', 'request_id': 'req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.735185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b092710ebd604907aafcd0945582f49a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.735914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-9dec86d3-e3a8-428f-b967-e1713825b3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b092710ebd604907aafcd0945582f49a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.743581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0c5c980cad411dac09cf81d1b7df88', 'request_id': 'req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.751518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0c5c980cad411dac09cf81d1b7df88', 'request_id': 'req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.753263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1198/2359] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:01 2022] DELETE /identity/v3/users/b092710ebd604907aafcd0945582f49a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:01.757926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f47b8-4c67-4fba-8f4d-ccedd48ff515 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.758216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f47b8-4c67-4fba-8f4d-ccedd48ff515 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.758493 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f47b8-4c67-4fba-8f4d-ccedd48ff515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.768424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] The token cache is being invalidate because project 7f0c5c980cad411dac09cf81d1b7df88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:01.769061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.774108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3f1f3bbb-27b5-4041-ae03-df940c8cba6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:01.776279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1162/2360] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:01 2022] DELETE /identity/v3/projects/7f0c5c980cad411dac09cf81d1b7df88 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:13:01.777463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.777756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.778277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.783620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-934f47b8-4c67-4fba-8f4d-ccedd48ff515 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.785123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-934f47b8-4c67-4fba-8f4d-ccedd48ff515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.800114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.801493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.860773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1199/2361] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:01.860773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.860773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.860773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.876169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1163/2362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:01.877107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.879178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.881149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.889129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1200/2363] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:01.889129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.889129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.895380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33d2c7-b001-4553-bdb4-d47c81645b3f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.899056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.899687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.899968 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.900243 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.900896 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:13:01.901202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.902848 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82de32-133b-489e-8145-c4178bc80fa4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.914251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1164/2364] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:13:01.915407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.915694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.915970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.935254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:01.936557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:01.944937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1165/2365] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:01.945741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.953037 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60bdc8-beac-44d3-a2ca-c4df4b3b9f3e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.955326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9088351-d8e9-4748-83b6-448746f6e1b4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.956803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.957463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.957750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.958606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.960486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:01.961087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:01.961406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:01.961687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:01.962308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.964224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.967876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:01.969376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:01.979485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1201/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:01.980302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:01.995435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b84207-c4f3-424b-a12d-350352a72743 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:01.998435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1166/2367] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:01 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:02.003451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.080571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.082074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.083481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.083848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.084673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:13:02.085059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.087701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.103871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1202/2368] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:13:02.104403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cb5a-dcc8-42de-adb9-83e575028154 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.107858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.110549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.111169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.111453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.111732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.112402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.114464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.120619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8374cb-973a-4347-8695-d69a62d2e5ef admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.128487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.129191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.129801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.129801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.130424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.132367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.137267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:02.143947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1167/2369] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:13:02.148283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.165178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbd30e-ca27-4bc5-a341-35caba2c5519 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.166205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1203/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:13:02.169908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.194958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:02.245189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.245827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.246139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.246417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.247072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.249292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.256717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc25c42-40e2-46c2-a3ba-76ea92c9cdab admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.261476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1168/2371] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:13:02.265260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.271522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.272182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.272490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.272765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.273440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.275432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.276985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf855d-e38f-424e-8b87-804c1ab26903 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.283138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.283870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.284382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.284758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.285538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.287783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.298670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1169/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:13:02.301413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1204/2373] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:02.306857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.307165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.318541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd354e-756e-4207-9829-003f002baf23 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.322386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ef07-af95-4e65-b861-2e61bfc08657 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.324561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.325549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.325834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.329437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] PATH_INFO: `/v3/projects/bded2f1ec311438497ed40ab7a60d490/users/1b78ffd1200d45b6b3d3c5323a2e8b93/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.331757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.332383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.332677 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.333282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.334574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.337569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.344110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bded2f1ec311438497ed40ab7a60d490, user_id=1b78ffd1200d45b6b3d3c5323a2e8b93, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.346825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.352446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1205/2374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:02.352446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.354011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.366104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1170/2375] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:02 2022] PUT /identity/v3/projects/bded2f1ec311438497ed40ab7a60d490/users/1b78ffd1200d45b6b3d3c5323a2e8b93/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:02.367261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.388244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85440-c336-4b36-ad05-cb2b0fc5f130 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.445178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65db094-3d96-4485-8c20-f09a36e9d3a5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.451532 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.452261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.452706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.453043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.453900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.455576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011daf1-71cc-49e3-8e10-893bc9cafae8 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.472367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1171/2376] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:02.472367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.472367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.472367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.502008 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.502746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.503116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.503550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] PATH_INFO: `/v3/projects/cb6a3bfcb1de4e8ba5f52bf5965c3620` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.504681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6a3bfcb1de4e8ba5f52bf5965c3620)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.505689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] MFA Rules not processed for user `1b78ffd1200d45b6b3d3c5323a2e8b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:02.506959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.507431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.580987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6a3bfcb1de4e8ba5f52bf5965c3620', 'request_id': 'req-0e366612-b37c-49f3-afc5-78395767726c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.588339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6a3bfcb1de4e8ba5f52bf5965c3620', 'request_id': 'req-0e366612-b37c-49f3-afc5-78395767726c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.595152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6a3bfcb1de4e8ba5f52bf5965c3620', 'request_id': 'req-0e366612-b37c-49f3-afc5-78395767726c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.597969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:02.612817 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] The token cache is being invalidate because project cb6a3bfcb1de4e8ba5f52bf5965c3620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:02.613296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.614077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.618490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1172/2377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:02.618490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.619845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1206/2378] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:02 2022] DELETE /identity/v3/projects/cb6a3bfcb1de4e8ba5f52bf5965c3620 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:02.620620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.625682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.633361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fa1d0-df2e-428d-80a8-62d245a39b53 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.642558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:02.694731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366612-b37c-49f3-afc5-78395767726c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.698540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.699199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.699383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.699524 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.699734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] PATH_INFO: `/v3/projects/c5e576ffa90d4118991edb48723664dc/users/5da7a95f6608401ab05b1dcf8767aa0f/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.700076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.700354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.700749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.701427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.703328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.715123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e576ffa90d4118991edb48723664dc, user_id=5da7a95f6608401ab05b1dcf8767aa0f, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.717915 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.734254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1207/2379] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:02.735375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.736793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1173/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:02 2022] PUT /identity/v3/projects/c5e576ffa90d4118991edb48723664dc/users/5da7a95f6608401ab05b1dcf8767aa0f/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:02.736912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.738303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.818831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd093e57-dfcb-4373-b3f4-1fa818abfba3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.824296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.825177 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.825760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.825949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e3d28-cf8c-479a-a0b3-568fdf2d3732 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.826055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] PATH_INFO: `/v3/users/44080ca8fa0e4a20af84e16dfc3889f8` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.827169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=44080ca8fa0e4a20af84e16dfc3889f8)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.829095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.831069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.831669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.831950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.832228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.833406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.835465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c06a7-35ea-4936-8809-722d30fe8319 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.858256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1174/2381] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:02.859635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.859927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.860214 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.881747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:02.883146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.891592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1175/2382] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:02.892401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.897895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44080ca8fa0e4a20af84e16dfc3889f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.911929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5db7-636f-4f80-9a00-e81b559b4a70 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:02.914223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44080ca8fa0e4a20af84e16dfc3889f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.914999 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44080ca8fa0e4a20af84e16dfc3889f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.916979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:02.917948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:02.917948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:02.918144 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:02.918789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:02.920373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:02.924217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44080ca8fa0e4a20af84e16dfc3889f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.924854 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44080ca8fa0e4a20af84e16dfc3889f8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:02.931385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1176/2383] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:02.932216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.935016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:02.940532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:02.942913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1208/2384] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:02 2022] DELETE /identity/v3/users/44080ca8fa0e4a20af84e16dfc3889f8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:02.944284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:02.945882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:03.023949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8839c0-a29c-4ed6-bdb4-ff4a9afccc60 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.036049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81d161-d43d-4ebf-974d-dcff3d4fc7ea admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.053059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:03.055012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.055663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.058959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.059321 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.060022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.070626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.089747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1209/2385] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:03.093763 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.096870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.097560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.097884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.098164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.100619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:03.106880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bede5-37a8-4dca-b049-2afe2bd5e4e5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.113377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.114117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.114405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.114692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] PATH_INFO: `/v3/projects/ba2f5867cda9475391f4fe61d7cc8187/users/147c8fe1b3e54c26a1d5882cc49775cb/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.114813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.116334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fa7aa-3c70-4cc4-9354-c0bb03f5a18f service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.132338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2f5867cda9475391f4fe61d7cc8187, user_id=147c8fe1b3e54c26a1d5882cc49775cb, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.133409 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1177/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:03.135288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.152409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1210/2387] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:03 2022] PUT /identity/v3/projects/ba2f5867cda9475391f4fe61d7cc8187/users/147c8fe1b3e54c26a1d5882cc49775cb/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:03.163276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.163685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.164093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.194467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] MFA Rules not processed for user `147c8fe1b3e54c26a1d5882cc49775cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:03.195840 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:03.274415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1178/2388] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:03.279150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.359517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a6d03-a0b6-4d0f-8d61-c684929f2c45 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.364716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.365366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.365653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.365930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.366585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.368783 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.420495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1211/2389] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:03 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:03.425031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.436963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055091b-a400-46ab-af5f-89eaa36a96fe None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.524168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.526829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.527459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.527837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.528599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.531377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.585118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1179/2390] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:03 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:13:03.590124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.608212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a759e-a8af-4ff5-a7c8-758bfcb13a51 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.617057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.619897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:03.634392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.635079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.635315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.636288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.639474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.644282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.656678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a640c0d-6d75-43cc-8165-c692c145c9c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.666822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1212/2391] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:03.667522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.667950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.668232 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.668503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] PATH_INFO: `/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.669938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4b31ad2d2647c1a97cf2b5503740e3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.671370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.673163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.687929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a0a96-2250-4069-82c9-91b4aeac7b68 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:03.694097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:03.694846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.695043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.695322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] PATH_INFO: `/v3/projects/f382e810d59f4d9bb6cc8f1339fac578/users/4d1bef9b0fa04ccabcb4e2699495d609/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.718979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f382e810d59f4d9bb6cc8f1339fac578, user_id=4d1bef9b0fa04ccabcb4e2699495d609, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:03.722294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:03.743322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1213/2392] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:03 2022] PUT /identity/v3/projects/f382e810d59f4d9bb6cc8f1339fac578/users/4d1bef9b0fa04ccabcb4e2699495d609/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:03.747227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:03.751978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:03.772248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4b31ad2d2647c1a97cf2b5503740e3', 'request_id': 'req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:03.784490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4b31ad2d2647c1a97cf2b5503740e3', 'request_id': 'req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:03.794422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:03.802645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4b31ad2d2647c1a97cf2b5503740e3', 'request_id': 'req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:03.820490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] The token cache is being invalidate because project ba4b31ad2d2647c1a97cf2b5503740e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:03.821384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:03.822293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b0bced5d-e908-41e4-a0eb-cbb2b4efde05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:03.829421 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1180/2393] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:03 2022] DELETE /identity/v3/projects/ba4b31ad2d2647c1a97cf2b5503740e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:13:03.832291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7eec4-d80d-4b27-8018-1790403e7459 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:03.832602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7eec4-d80d-4b27-8018-1790403e7459 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:03.833640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7eec4-d80d-4b27-8018-1790403e7459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:03.867707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-6fd7eec4-d80d-4b27-8018-1790403e7459 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:03.869084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6fd7eec4-d80d-4b27-8018-1790403e7459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.017736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1181/2394] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:04.021700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeddb9-d5b2-4b09-863a-0be8e83486af None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.022049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeddb9-d5b2-4b09-863a-0be8e83486af None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.022326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeddb9-d5b2-4b09-863a-0be8e83486af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.056558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1379-a4ef-41c7-83af-c92329be5e7e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.065142 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-96eeddb9-d5b2-4b09-863a-0be8e83486af None None] MFA Rules not processed for user `5da7a95f6608401ab05b1dcf8767aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:04.068345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.068973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.069276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.069541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.070187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.071961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099caa2-0934-4046-877e-e547277864e7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.072149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-96eeddb9-d5b2-4b09-863a-0be8e83486af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.084215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1214/2395] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:04.089345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.089787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.090329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.119166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:04.121047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.134102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1215/2396] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:04.135231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.136304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.157549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033670b-05eb-4246-9af0-09a1c34c9368 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.165499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.166416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.166842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.167287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] PATH_INFO: `/v3/projects/f382e810d59f4d9bb6cc8f1339fac578/users/4d1bef9b0fa04ccabcb4e2699495d609/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.170768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f382e810d59f4d9bb6cc8f1339fac578, user_id=4d1bef9b0fa04ccabcb4e2699495d609, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.174221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.197068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1216/2397] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:04 2022] PUT /identity/v3/projects/f382e810d59f4d9bb6cc8f1339fac578/users/4d1bef9b0fa04ccabcb4e2699495d609/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:04.198192 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.210933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1182/2398] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:04.212937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.215463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.216067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.249974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] MFA Rules not processed for user `4d1bef9b0fa04ccabcb4e2699495d609`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:04.251352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.296919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907645c-2628-43f6-a984-defcfc44b8d2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.303402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.303686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:04.304024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.304309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.304585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.305821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:13:04.305821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.307367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.321849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1217/2399] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:13:04.322963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.324634 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.347418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1183/2400] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:04.347418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.359356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf00391-60e6-4389-a1b2-a87afa4989a2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.372602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.373487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.373864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.375309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.375309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.377548 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.412311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1184/2401] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:04.413390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.415125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.435442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58f4b-c6b1-48d1-b241-6de7b4bda4aa admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.481898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:04.482591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11313599-57ce-477b-880e-ce39bfe5c5b5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.488908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.490173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.490458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.490730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.494638 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.497571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.497571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.497571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.498376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.556422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.557938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.565012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.566540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.568613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1218/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:04.574146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.579293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1185/2403] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:04.652926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ba61-c4f1-4204-b775-d1c4cce6695d service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.657963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.658649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.658987 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.659327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.660015 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.662067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.684765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1219/2404] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:04.688940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.704727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9e71-4057-4281-87ac-3f3fb691c611 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.710523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.711126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.711775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.711775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.712496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.714201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.725122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1186/2405] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:04.729275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.739668 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969797d-1558-49ea-8cbd-28065f7e5aed admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.745339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.746014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.746361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.746697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.747620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.749103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce16110-8807-449a-9880-028f29c51383 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.760408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1220/2406] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:04.764227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.790195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450153-c468-4aa8-abbe-63dd557b560f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:04.795274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:04.795938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.796370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.796490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] PATH_INFO: `/v3/projects/8a8728f4f9154471aee34083c0144b4a/users/abc6ba9f194c4b21b1cb3d95c418ffa4/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.815714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8728f4f9154471aee34083c0144b4a, user_id=abc6ba9f194c4b21b1cb3d95c418ffa4, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:04.818464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:04.831975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1187/2407] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:04 2022] PUT /identity/v3/projects/8a8728f4f9154471aee34083c0144b4a/users/abc6ba9f194c4b21b1cb3d95c418ffa4/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:04.843378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7a86-86f1-419b-966a-33107186f082 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:04.843673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7a86-86f1-419b-966a-33107186f082 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:04.843952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7a86-86f1-419b-966a-33107186f082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:04.874632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-42ae7a86-86f1-419b-966a-33107186f082 None None] MFA Rules not processed for user `abc6ba9f194c4b21b1cb3d95c418ffa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:04.875872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-42ae7a86-86f1-419b-966a-33107186f082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:04.953878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1221/2408] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:04.968794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:04.970689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:05.033745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:05.054569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9dbe7-416d-44ce-b92e-7d167f1aeda9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:05.060466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:05.061835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:05.062481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:05.062920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:05.073355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:05.074935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:05.085321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1188/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:06.069164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:06.069655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:06.070046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:06.096600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] MFA Rules not processed for user `5da7a95f6608401ab05b1dcf8767aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:06.098170 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:06.106340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:06.201947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1222/2410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:06.246930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:06.321123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5d2d-c050-42f6-b6a7-e3c9c9971cb5 service glance] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:06.325620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:06.326437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:06.326723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:06.327007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:06.328766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:06.403927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:06.405430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:06.415222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1189/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:07.149158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:07.159832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda50e-46fe-4cb6-bc03-9cfe9c00b8e3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:07.165121 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:07.165953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:07.166392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:07.166755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:07.244108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:07.246440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451884-7d00-4b02-a5a6-cb569755523f service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:07.257354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1223/2412] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:11.256363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:11.326675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c0823-0a7f-4d4f-8b8e-d4399a89fbf4 service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:11.331226 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:11.331881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:11.332390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:11.332701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] PATH_INFO: `/v3/users/1b78ffd1200d45b6b3d3c5323a2e8b93` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:11.333855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b78ffd1200d45b6b3d3c5323a2e8b93)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:11.335788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:11.399476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:11.408678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b78ffd1200d45b6b3d3c5323a2e8b93'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:11.438456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b78ffd1200d45b6b3d3c5323a2e8b93'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:11.448078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b78ffd1200d45b6b3d3c5323a2e8b93'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:11.448731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b78ffd1200d45b6b3d3c5323a2e8b93'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:11.450198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b78ffd1200d45b6b3d3c5323a2e8b93'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:11.474565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1190/2413] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:11 2022] DELETE /identity/v3/users/1b78ffd1200d45b6b3d3c5323a2e8b93 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:11.479014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866d38-f1ac-4ab6-aaed-eeedc4abaaeb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:11.479485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866d38-f1ac-4ab6-aaed-eeedc4abaaeb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:11.479604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866d38-f1ac-4ab6-aaed-eeedc4abaaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:11.499353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-93866d38-f1ac-4ab6-aaed-eeedc4abaaeb None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:11.500536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-93866d38-f1ac-4ab6-aaed-eeedc4abaaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:11.562801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1224/2414] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:11.574691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:11.576256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:11.664616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cd386-40f3-4b5e-b1a2-2f7c9d87515a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:11.669056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:11.669707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:11.670066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:11.670661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:11.672537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:11.672991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:11.673394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:11.681903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:11.683646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:11.698234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1191/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:11.699342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:11.700738 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:11.790561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:11.805842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1225/2416] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:11.822048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:11.823766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:11.971819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6333d-b0ea-403d-84cc-0e327e85c448 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:11.979342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:11.981103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:11.981647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:11.982078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:11.994291 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:11.996465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:12.012629 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1192/2417] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:13:12.172781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:12.175060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:12.192549 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217d2cb-0805-4a41-acb4-f0d1cef3762b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:12.199368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:12.200675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:12.200961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:12.201300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] PATH_INFO: `/v3/projects/bded2f1ec311438497ed40ab7a60d490` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:12.204613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bded2f1ec311438497ed40ab7a60d490)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:12.215595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:12.323842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bded2f1ec311438497ed40ab7a60d490', 'request_id': 'req-dc1bbd55-7524-4834-9906-083d8566eb57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.332502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bded2f1ec311438497ed40ab7a60d490', 'request_id': 'req-dc1bbd55-7524-4834-9906-083d8566eb57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.346166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bded2f1ec311438497ed40ab7a60d490', 'request_id': 'req-dc1bbd55-7524-4834-9906-083d8566eb57'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.380115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] The token cache is being invalidate because project bded2f1ec311438497ed40ab7a60d490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:12.380696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.381542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.383673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1226/2418] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:12 2022] DELETE /identity/v3/projects/bded2f1ec311438497ed40ab7a60d490 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:12.387467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:12.401770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62097f-f65d-49bb-9ee5-9646b14d1c5e service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:12.530790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:12.554844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:12.556003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:12.556454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:12.558211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] PATH_INFO: `/v3/users/147c8fe1b3e54c26a1d5882cc49775cb` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:12.563084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147c8fe1b3e54c26a1d5882cc49775cb)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:12.565907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:12.757255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147c8fe1b3e54c26a1d5882cc49775cb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.804326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147c8fe1b3e54c26a1d5882cc49775cb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.836477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147c8fe1b3e54c26a1d5882cc49775cb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.837482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147c8fe1b3e54c26a1d5882cc49775cb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.838136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147c8fe1b3e54c26a1d5882cc49775cb'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:12.857850 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1193/2419] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:12 2022] DELETE /identity/v3/users/147c8fe1b3e54c26a1d5882cc49775cb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:13.464024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:13.466540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:13.501982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bbd55-7524-4834-9906-083d8566eb57 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:13.659329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:13.662195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:13.662961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:13.663568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] PATH_INFO: `/v3/projects/ba2f5867cda9475391f4fe61d7cc8187` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:13.665408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2f5867cda9475391f4fe61d7cc8187)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:13.667686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:13.801949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2f5867cda9475391f4fe61d7cc8187', 'request_id': 'req-e81f6296-338d-4532-b044-072107fae4be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:13.816666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2f5867cda9475391f4fe61d7cc8187', 'request_id': 'req-e81f6296-338d-4532-b044-072107fae4be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:13.836919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2f5867cda9475391f4fe61d7cc8187', 'request_id': 'req-e81f6296-338d-4532-b044-072107fae4be'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:13.876724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] The token cache is being invalidate because project ba2f5867cda9475391f4fe61d7cc8187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:13.880059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:13.882530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:13.888343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1227/2420] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:13 2022] DELETE /identity/v3/projects/ba2f5867cda9475391f4fe61d7cc8187 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:13.892041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:13.894251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:13.918324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86b6b-9a00-490d-91a7-a79ee22dd0e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:14.137971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:14.139153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:14.139358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:14.139642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] PATH_INFO: `/v3/users/4d1bef9b0fa04ccabcb4e2699495d609` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:14.140847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1bef9b0fa04ccabcb4e2699495d609)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:14.142858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:14.235182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1bef9b0fa04ccabcb4e2699495d609'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:14.267323 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1bef9b0fa04ccabcb4e2699495d609'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:14.287680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:14.316121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1bef9b0fa04ccabcb4e2699495d609'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:14.318286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1bef9b0fa04ccabcb4e2699495d609'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:14.319325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-13d8c32e-1ca9-4ac8-bf4e-a14c7e361990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1bef9b0fa04ccabcb4e2699495d609'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:14.361956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1194/2421] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:13 2022] DELETE /identity/v3/users/4d1bef9b0fa04ccabcb4e2699495d609 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:15.117180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:15.119455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:15.144139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f6296-338d-4532-b044-072107fae4be admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:15.149647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:15.185463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7d72-e136-4e8a-b2cf-357086e16acc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:15.186398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7d72-e136-4e8a-b2cf-357086e16acc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:15.186813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a7d72-e136-4e8a-b2cf-357086e16acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:15.231580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-460a7d72-e136-4e8a-b2cf-357086e16acc None None] MFA Rules not processed for user `3603342a11f14f3d9edd7dbcbf08d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:15.234057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-460a7d72-e136-4e8a-b2cf-357086e16acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:15.339580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:15.340659 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:15.345688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:15.346196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] PATH_INFO: `/v3/projects/f382e810d59f4d9bb6cc8f1339fac578` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:15.347865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f382e810d59f4d9bb6cc8f1339fac578)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:15.350061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:15.392926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1195/2422] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:15.445776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f382e810d59f4d9bb6cc8f1339fac578', 'request_id': 'req-3836aef1-6dcb-484d-84a1-fdfea5172429'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:15.460365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f382e810d59f4d9bb6cc8f1339fac578', 'request_id': 'req-3836aef1-6dcb-484d-84a1-fdfea5172429'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:15.471707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f382e810d59f4d9bb6cc8f1339fac578', 'request_id': 'req-3836aef1-6dcb-484d-84a1-fdfea5172429'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:15.521625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] The token cache is being invalidate because project f382e810d59f4d9bb6cc8f1339fac578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:15.521941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:15.522609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:15.525097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1228/2423] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:15 2022] DELETE /identity/v3/projects/f382e810d59f4d9bb6cc8f1339fac578 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:18.213359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f965c8-9ed5-44e7-b7ab-add7721d5e10 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:18.213926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f965c8-9ed5-44e7-b7ab-add7721d5e10 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:18.215067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f965c8-9ed5-44e7-b7ab-add7721d5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:18.263880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b3f965c8-9ed5-44e7-b7ab-add7721d5e10 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:18.267075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b3f965c8-9ed5-44e7-b7ab-add7721d5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:18.376952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1196/2424] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:18.393544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:18.395482 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:18.522721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836aef1-6dcb-484d-84a1-fdfea5172429 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:18.529011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:18.544361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:18.544361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:18.544880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:18.566063 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:18.568053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc19f8-ec0b-4d7d-9c7c-cd448ab2866d service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:18.578032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1229/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:13:28.353547 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=56 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:28.573649 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:32.991093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f0a1-2f95-4a9b-9e9d-c1daab454fca None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:32.993637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f0a1-2f95-4a9b-9e9d-c1daab454fca None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:32.994522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f0a1-2f95-4a9b-9e9d-c1daab454fca None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:32.997607 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1197/2426] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:13:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:13:33.003586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:33.004166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:33.004166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:33.035990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:33.039787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:33.196910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1230/2427] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:40.128677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60cb0-eba1-49a9-b376-945f605dfe0a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:40.129159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60cb0-eba1-49a9-b376-945f605dfe0a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:40.129377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c60cb0-eba1-49a9-b376-945f605dfe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:40.154929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-94c60cb0-eba1-49a9-b376-945f605dfe0a None None] MFA Rules not processed for user `5fca6a15a17c423393582da43abec450`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:40.156784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-94c60cb0-eba1-49a9-b376-945f605dfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:40.173241 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:40.176074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:40.264309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22b3b-8b34-4c36-9791-7b3354f13900 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:40.269263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:40.269931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:40.270179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:40.270499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] PATH_INFO: `/v3/users/abc6ba9f194c4b21b1cb3d95c418ffa4` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:40.271721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc6ba9f194c4b21b1cb3d95c418ffa4)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:40.273673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1198/2428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:40.278086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:40.345847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc6ba9f194c4b21b1cb3d95c418ffa4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:40.359537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc6ba9f194c4b21b1cb3d95c418ffa4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:40.360449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc6ba9f194c4b21b1cb3d95c418ffa4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:40.372612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc6ba9f194c4b21b1cb3d95c418ffa4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:40.373719 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc6ba9f194c4b21b1cb3d95c418ffa4'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:40.393054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1231/2429] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:40 2022] DELETE /identity/v3/users/abc6ba9f194c4b21b1cb3d95c418ffa4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:13:40.399035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:40.399271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:40.399554 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:40.422773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:40.424488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:40.495941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1199/2430] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:40.506844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:40.508651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:40.524584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:40.574481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496da6a1-de5c-4730-b56d-4ea31aa00023 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:40.584054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:40.584699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:40.584982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:40.585273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:40.601253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:40.602799 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e84445-d114-4e51-aa38-c2d78ee56455 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:40.617624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1232/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:41.064209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.065854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:41.079940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cfcc-fa50-4486-a5c8-628e574c8b94 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.085862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.086667 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.087251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.087624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] PATH_INFO: `/v3/projects/8a8728f4f9154471aee34083c0144b4a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.088894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8728f4f9154471aee34083c0144b4a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.090986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.142616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8728f4f9154471aee34083c0144b4a', 'request_id': 'req-313087d0-361a-42ac-a43a-b2ab483c9d8e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:41.152260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8728f4f9154471aee34083c0144b4a', 'request_id': 'req-313087d0-361a-42ac-a43a-b2ab483c9d8e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:41.158681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8728f4f9154471aee34083c0144b4a', 'request_id': 'req-313087d0-361a-42ac-a43a-b2ab483c9d8e'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:41.171842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] The token cache is being invalidate because project 8a8728f4f9154471aee34083c0144b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:41.172063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:41.172794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-313087d0-361a-42ac-a43a-b2ab483c9d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:41.174340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1200/2432] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:41 2022] DELETE /identity/v3/projects/8a8728f4f9154471aee34083c0144b4a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:41.179296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.180085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.180085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.205214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:41.207548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:41.274942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1233/2433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:41.283747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.284167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.285113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.308198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:41.309549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:41.318529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1201/2434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:41.322941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.335608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fdbe0-0549-4e27-9f7d-9db21b21e227 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.341050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.341880 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.342235 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.342704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.343438 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:13:41.343747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.345778 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.361260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1234/2435] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:13:41.365422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.375775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3971e8-347a-4598-bd97-03b7d4292bfc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.381939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.382390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.382725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.383006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.384074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.386504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.417748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:41.434331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1202/2436] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:13:41 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:13:41.435335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.448458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bacab6-7cf8-4a46-81ea-df81dbdbf3c1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.516098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.516754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.517045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.517395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.518217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.520879 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.549269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1235/2437] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:13:41 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:13:41.551757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.562246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bfb7-da00-47c5-afe0-1cf5c81e0a2f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.567152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.567862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.568151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.568424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.569087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.570701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.582703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1203/2438] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:41.587377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.598147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e493452-674f-4b98-865f-a5aaefdb6f5e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.603169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.603776 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.604061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.604338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.605005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.606655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9a7dc-dd2e-4705-8917-37dc7bd367e4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.619106 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1236/2439] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:13:41.623693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.636327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914ce6b-1bbf-46c8-9535-96e494b63b8d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.642182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.642967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.643309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.643653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] PATH_INFO: `/v3/projects/9bf5779236774796a069dafb125aabc5/users/73b10080c95c4aa4a380933cde859bdd/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.662454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf5779236774796a069dafb125aabc5, user_id=73b10080c95c4aa4a380933cde859bdd, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.665266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.681159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1204/2440] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:13:41 2022] PUT /identity/v3/projects/9bf5779236774796a069dafb125aabc5/users/73b10080c95c4aa4a380933cde859bdd/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:41.696078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.696441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.696894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.744474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] MFA Rules not processed for user `73b10080c95c4aa4a380933cde859bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:41.745924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:41.756395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:41.835317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1237/2441] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:41.848734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:41.851058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:41.926516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba6681-2fa3-421f-b87c-075eec75f03f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:41.933333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:41.933925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:41.934238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:41.934544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:41.943888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:41.945398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20584c9c-c126-432f-bf1d-9cb71c6b1887 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:41.954995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1205/2442] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:44.192381 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:44.194713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:44.256853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29801-4fa1-471c-85c7-d49e667272a1 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:44.261614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:44.262219 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.262500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.262772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.264469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:44.332331 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:44.333714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781dee0-190e-48fc-828f-a2bcc6d08a37 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:44.343961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1238/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:44.446976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.447540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.447540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.448873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1206/2444] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:13:44.453592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c66124-585e-47d6-b872-77e5273045cb None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.453947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c66124-585e-47d6-b872-77e5273045cb None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.454335 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c66124-585e-47d6-b872-77e5273045cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.474696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73c66124-585e-47d6-b872-77e5273045cb None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:44.475916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73c66124-585e-47d6-b872-77e5273045cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:44.522174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:44.533547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1239/2445] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:13:44.541741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:44.544169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:44.557571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b458f3-356f-450a-8049-5db1cad175b0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:44.561117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:44.561746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.562046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.562321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.570355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:44.571798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33b36-5aab-4e54-bd89-11c0132e05d5 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:44.600019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1207/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:13:44.739981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c9d9-6fef-4b68-b240-80497805876e None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.740269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c9d9-6fef-4b68-b240-80497805876e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.740550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c9d9-6fef-4b68-b240-80497805876e None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.742203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1240/2447] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:13:44.748065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024730c-e577-4447-ab0b-edd5bdd328a7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.748358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024730c-e577-4447-ab0b-edd5bdd328a7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.748646 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024730c-e577-4447-ab0b-edd5bdd328a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.788043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-7024730c-e577-4447-ab0b-edd5bdd328a7 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:44.789861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7024730c-e577-4447-ab0b-edd5bdd328a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:44.813438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1208/2448] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:44.835499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c9d9-6fef-4b68-b240-80497805876e None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:44.846657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c9d9-6fef-4b68-b240-80497805876e None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:44.850744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:44.851418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:44.851819 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:44.852156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:44.890187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:44.893076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:44.910553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1241/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:13:45.367208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5e3b-5704-41e0-8cdb-c4ec870c5c54 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:45.367845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5e3b-5704-41e0-8cdb-c4ec870c5c54 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:45.368186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a5e3b-5704-41e0-8cdb-c4ec870c5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:45.391824 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-311a5e3b-5704-41e0-8cdb-c4ec870c5c54 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:45.395412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-311a5e3b-5704-41e0-8cdb-c4ec870c5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:45.470221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1209/2450] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:45.497704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:45.500300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:45.600966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7944-5ba3-4e2c-964c-8070af4a3886 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:45.607304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:45.608114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:45.608463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:45.608805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:45.621832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:45.623477 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:45.632829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1242/2451] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:13:48.523984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb494-c6b0-4c64-b0db-0aa50930a77e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:48.524471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb494-c6b0-4c64-b0db-0aa50930a77e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:48.524564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddb494-c6b0-4c64-b0db-0aa50930a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:48.544500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-33ddb494-c6b0-4c64-b0db-0aa50930a77e None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:48.546247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-33ddb494-c6b0-4c64-b0db-0aa50930a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:48.561076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1210/2452] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:48.575174 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:48.591139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd676b7c-dbf0-4bbc-8b83-f42355f3648b service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:48.597825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:48.598086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:48.598208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:48.598413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:48.608330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:48.609989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16bb56-842f-4f46-b271-338cfd53da55 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:48.619496 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1243/2453] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:13:48.625798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de657-2217-4ce6-b627-5af48df0912f None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:48.626384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de657-2217-4ce6-b627-5af48df0912f None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:48.626755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de657-2217-4ce6-b627-5af48df0912f None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:48.628362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1211/2454] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:13:48.642300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:48.642563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:48.642973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:48.663814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:48.664969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:48.810754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de657-2217-4ce6-b627-5af48df0912f None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:48.812666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-769de657-2217-4ce6-b627-5af48df0912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:48.833355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1244/2455] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:48.857020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:48.859175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:48.885956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a42ff7-eb98-4cba-8736-156eb5d17947 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:48.894593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:48.897373 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:48.898775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:48.899059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:48.919836 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:48.921779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:48.947405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1245/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:13:48.961333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:48.998592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de657-2217-4ce6-b627-5af48df0912f None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:49.009954 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:49.012907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:49.013723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:49.014377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] PATH_INFO: `/v3/users/f93fd1c9b91a4705a02229b909158004` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:49.017006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93fd1c9b91a4705a02229b909158004)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:49.022394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:49.145756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93fd1c9b91a4705a02229b909158004'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.171015 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93fd1c9b91a4705a02229b909158004'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.181852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93fd1c9b91a4705a02229b909158004'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.182515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93fd1c9b91a4705a02229b909158004'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.183248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93fd1c9b91a4705a02229b909158004'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.218401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1212/2457] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:48 2022] DELETE /identity/v3/users/f93fd1c9b91a4705a02229b909158004 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:13:49.533415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:49.554963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92163c8-b03c-4477-88db-71426755f8a2 service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:49.626683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:49.656815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:49.657534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:49.657824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:49.658506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] PATH_INFO: `/v3/projects/4ee184de1a764cb491848ac692efd21c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:49.661204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee184de1a764cb491848ac692efd21c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:49.664941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:49.734889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee184de1a764cb491848ac692efd21c', 'request_id': 'req-bb308413-e229-49b9-8967-d674fa5829e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.749619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee184de1a764cb491848ac692efd21c', 'request_id': 'req-bb308413-e229-49b9-8967-d674fa5829e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.758261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee184de1a764cb491848ac692efd21c', 'request_id': 'req-bb308413-e229-49b9-8967-d674fa5829e0'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.776133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] The token cache is being invalidate because project 4ee184de1a764cb491848ac692efd21c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:49.776503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.777135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bb308413-e229-49b9-8967-d674fa5829e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:49.782832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1246/2458] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:49 2022] DELETE /identity/v3/projects/4ee184de1a764cb491848ac692efd21c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:52.704749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:52.706321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:52.721918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc51d3-6a42-4160-954e-b9730a6a7af5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:52.793016 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:52.793827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:52.794173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:52.794404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] PATH_INFO: `/v3/users/73b10080c95c4aa4a380933cde859bdd` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:52.795555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b10080c95c4aa4a380933cde859bdd)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:52.797723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:52.848282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b10080c95c4aa4a380933cde859bdd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:52.859778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b10080c95c4aa4a380933cde859bdd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:52.862273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:52.868026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b10080c95c4aa4a380933cde859bdd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:52.868738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b10080c95c4aa4a380933cde859bdd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:52.869613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b10080c95c4aa4a380933cde859bdd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:52.883002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1213/2459] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:13:52 2022] DELETE /identity/v3/users/73b10080c95c4aa4a380933cde859bdd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:13:52.887511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:52.888051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:52.888156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:52.907126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:13:52.908490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:52.971137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1247/2460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:13:52.981357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:52.982902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:53.054772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee1653-9b8b-4b0c-aeef-8ece48782b45 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:53.058579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:53.059190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:53.059474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:53.059751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:53.069622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:53.071140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48ec0c-6159-4771-bdd4-128dcd93594a service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:53.082333 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1214/2461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:13:53.420377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:13:53.421972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:13:53.434722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a8b3-e170-4538-b036-a71094ade2ff None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:13:53.441832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:13:53.442567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:13:53.442990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:13:53.443278 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] PATH_INFO: `/v3/projects/9bf5779236774796a069dafb125aabc5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:13:53.444660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf5779236774796a069dafb125aabc5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:13:53.446623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:13:53.512363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf5779236774796a069dafb125aabc5', 'request_id': 'req-838f155f-b890-41d0-8dd7-82e804e51f89'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:53.518239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf5779236774796a069dafb125aabc5', 'request_id': 'req-838f155f-b890-41d0-8dd7-82e804e51f89'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:53.525876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf5779236774796a069dafb125aabc5', 'request_id': 'req-838f155f-b890-41d0-8dd7-82e804e51f89'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:53.547069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:13:53.558713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] The token cache is being invalidate because project 9bf5779236774796a069dafb125aabc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:13:53.559299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:53.560132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:13:53.562095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1248/2462] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:13:53 2022] DELETE /identity/v3/projects/9bf5779236774796a069dafb125aabc5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:14:02.896531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ec75-0fd2-4d94-9b6b-4a1171e9c212 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:02.897005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ec75-0fd2-4d94-9b6b-4a1171e9c212 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:02.897203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ec75-0fd2-4d94-9b6b-4a1171e9c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:02.917059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0694ec75-0fd2-4d94-9b6b-4a1171e9c212 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:02.918279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0694ec75-0fd2-4d94-9b6b-4a1171e9c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:02.978372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1215/2463] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:03.006574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:03.008032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:03.087861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f155f-b890-41d0-8dd7-82e804e51f89 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:03.093160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:03.093796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:03.094074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:03.094346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:03.102694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:03.104255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:03.113558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1249/2464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:05.931060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c27e-3dc6-4e3a-8a61-dff793a58fa8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:05.931596 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c27e-3dc6-4e3a-8a61-dff793a58fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:05.931702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c27e-3dc6-4e3a-8a61-dff793a58fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:05.951052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-dba0c27e-3dc6-4e3a-8a61-dff793a58fa8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:05.956437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-dba0c27e-3dc6-4e3a-8a61-dff793a58fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:05.964934 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1216/2465] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:05.992285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:06.004212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f346e-867f-4a07-95ef-d703d0094a35 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:06.009656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:06.010279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:06.010564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:06.010845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:06.018922 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:06.020578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:06.030294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1250/2466] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:07.255544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacdf3-e2c1-49cf-bc54-41d12ba00067 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:07.256469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacdf3-e2c1-49cf-bc54-41d12ba00067 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:07.256979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bacdf3-e2c1-49cf-bc54-41d12ba00067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:07.277452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-43bacdf3-e2c1-49cf-bc54-41d12ba00067 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:07.278649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-43bacdf3-e2c1-49cf-bc54-41d12ba00067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:07.334651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1217/2467] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:14:07.359122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:07.360515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:07.428927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552bc9-829d-4067-847b-0405949f00f5 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:07.433838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:07.434441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:07.434721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:07.434994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:07.442908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:07.444464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:07.452423 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1251/2468] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:14:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:14:09.173201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256272e-908b-4a7e-a37a-99346651ac36 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:09.173763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256272e-908b-4a7e-a37a-99346651ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:09.173763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256272e-908b-4a7e-a37a-99346651ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:09.193151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c256272e-908b-4a7e-a37a-99346651ac36 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:09.194367 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c256272e-908b-4a7e-a37a-99346651ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:09.202068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1218/2469] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:09.217737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:09.229536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189940-153c-4cd3-b2e4-13864de191b6 service swift] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:09.234901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:09.235547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:09.235835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:09.236107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:09.244221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:09.245826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:09.255427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1252/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:12.259609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709e47-ef3c-415c-b7c6-5ee797e0f7a4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:12.260067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709e47-ef3c-415c-b7c6-5ee797e0f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:12.260368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709e47-ef3c-415c-b7c6-5ee797e0f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:12.281983 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e7709e47-ef3c-415c-b7c6-5ee797e0f7a4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:12.283326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7709e47-ef3c-415c-b7c6-5ee797e0f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:12.292583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1219/2471] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:12.307568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:12.309070 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:12.324036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f401f1-d406-4ee9-950d-75f5d6a3f362 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:12.330162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:12.330846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:12.331197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:12.331547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:12.345903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:12.347518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:12.359215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1253/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:15.459997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84bdd-977d-4c15-a4b7-14fbcdb9d16b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:15.460492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84bdd-977d-4c15-a4b7-14fbcdb9d16b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:15.460602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f84bdd-977d-4c15-a4b7-14fbcdb9d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:15.479499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-31f84bdd-977d-4c15-a4b7-14fbcdb9d16b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:15.480691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-31f84bdd-977d-4c15-a4b7-14fbcdb9d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:15.488370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1220/2473] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:15.510551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:15.521867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7229-54d3-4deb-86c5-afba08815f1a service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:15.527363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:15.527957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:15.528239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:15.528514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:15.536689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:15.538294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:15.547794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1254/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:18.602389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:18.602866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:18.602866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:18.617169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:18.622822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:18.624216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:18.632560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1221/2475] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:18.649487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:18.660450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1a703-7295-441a-9a5a-b19a481ea004 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:18.666466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:18.667086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:18.667366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:18.667641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:18.675842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:18.678709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198b5d4-f702-49fb-8405-45a4f2068402 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:18.689964 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1255/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:28.543761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:28.545935 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:28.618399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79fdad-45a9-4993-bf59-a16d4d4201ec None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:28.624299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:28.624914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:28.625209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:28.625493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:28.627312 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:28.640601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:28.642279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99324192-b3cf-45b0-92e7-463939b4007e service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:28.654229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1222/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:28.685349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:34.967788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5909d5-46c9-4edf-99d2-0c5c08e744f5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:34.968345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5909d5-46c9-4edf-99d2-0c5c08e744f5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:34.968345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5909d5-46c9-4edf-99d2-0c5c08e744f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:34.986728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-8d5909d5-46c9-4edf-99d2-0c5c08e744f5 None None] MFA Rules not processed for user `5da7a95f6608401ab05b1dcf8767aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:34.987901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8d5909d5-46c9-4edf-99d2-0c5c08e744f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:35.041825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1256/2478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:38.649372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=32 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:45.034915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=25 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:14:45.355526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:45.356017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:45.356122 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:45.375363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] MFA Rules not processed for user `3603342a11f14f3d9edd7dbcbf08d72d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:45.376474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:45.431346 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1223/2479] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:14:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:50.910236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbced7d-85ba-48c2-9209-8a3f83cc78d8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:50.911643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbced7d-85ba-48c2-9209-8a3f83cc78d8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:50.912410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbced7d-85ba-48c2-9209-8a3f83cc78d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:50.948650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2bbced7d-85ba-48c2-9209-8a3f83cc78d8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:50.953571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2bbced7d-85ba-48c2-9209-8a3f83cc78d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:50.965318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1257/2480] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:50.979553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:51.009258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84224a1f-e7b6-44d3-8f9c-f252683bed85 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:51.020818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:51.022395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:51.022866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:51.023270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:51.039911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:51.042600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:51.058551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1224/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:14:55.239948 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0c1e-d7ac-4da2-ad49-e7bb2d27f2f1 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:55.240716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0c1e-d7ac-4da2-ad49-e7bb2d27f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:55.240830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0c1e-d7ac-4da2-ad49-e7bb2d27f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:55.266443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-860d0c1e-d7ac-4da2-ad49-e7bb2d27f2f1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:55.267759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-860d0c1e-d7ac-4da2-ad49-e7bb2d27f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:55.277562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1258/2482] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:55.291698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:55.304466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ba9a-b792-4f18-84c3-ac205006f236 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:55.311064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:55.311689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:55.312004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:55.312281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:55.323671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:55.326072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:55.337073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1225/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:14:59.457262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9a81-75c3-487d-abc3-e932afc8955a None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:59.457777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9a81-75c3-487d-abc3-e932afc8955a None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:59.457921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c9a81-75c3-487d-abc3-e932afc8955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:59.491204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-af0c9a81-75c3-487d-abc3-e932afc8955a None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:14:59.492713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-af0c9a81-75c3-487d-abc3-e932afc8955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:14:59.502596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1259/2484] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:14:59.518575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:14:59.534309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8ac91-f151-48e6-bbab-c6bbd211698d service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:14:59.545863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:14:59.547477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:14:59.548030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:14:59.548895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:14:59.562357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:14:59.564183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9315-1fc5-4e63-90ce-34162457da32 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:14:59.576033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1226/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:15:00.307495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:00.307780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:00.308062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:00.327347 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] MFA Rules not processed for user `e805d10dcc2e4dc7baf6792c7ca53510`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:00.328601 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:00.384344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1260/2486] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:02.648967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5764cf-62f6-419b-a776-d3df9a0418f1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:02.649495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5764cf-62f6-419b-a776-d3df9a0418f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:02.649682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5764cf-62f6-419b-a776-d3df9a0418f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:02.668859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-0f5764cf-62f6-419b-a776-d3df9a0418f1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:02.670083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-0f5764cf-62f6-419b-a776-d3df9a0418f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:02.679003 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1227/2487] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:02.692588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:02.705620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d993f-ab87-4ed0-86f8-ad155ad18a13 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:02.710988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:02.711591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:02.711872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:02.712151 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:02.720238 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:02.721847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:02.731329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1261/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:05.872868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face534-bb7e-4eca-961c-387159643a66 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:05.873440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face534-bb7e-4eca-961c-387159643a66 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:05.873579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face534-bb7e-4eca-961c-387159643a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:05.894169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2face534-bb7e-4eca-961c-387159643a66 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:05.895435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2face534-bb7e-4eca-961c-387159643a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:05.904072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1228/2489] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Oct 5 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:05.919163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:05.930647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e8d3-c880-4e58-bb91-65dff154f06d service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:05.936190 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:05.936790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:05.937074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:05.937377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:05.945845 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:05.947436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:05.957124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1262/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:14.938760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:14.939247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:14.939342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:14.946666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=50 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:14.959796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] MFA Rules not processed for user `5fca6a15a17c423393582da43abec450`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:14.961008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:15.016792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1229/2491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:15.952695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=46 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:25.010288 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=24 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:37.487172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:37.488631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:37.501802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f98d9-263a-4eb6-9015-594ada2fe27b service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:37.506843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:37.507466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:37.507747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:37.508027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] PATH_INFO: `/v3/users/5da7a95f6608401ab05b1dcf8767aa0f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:37.509136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da7a95f6608401ab05b1dcf8767aa0f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:37.511114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:37.556191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da7a95f6608401ab05b1dcf8767aa0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.568375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da7a95f6608401ab05b1dcf8767aa0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.569040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da7a95f6608401ab05b1dcf8767aa0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.575991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da7a95f6608401ab05b1dcf8767aa0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.576604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da7a95f6608401ab05b1dcf8767aa0f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.589032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1263/2492] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:37 2022] DELETE /identity/v3/users/5da7a95f6608401ab05b1dcf8767aa0f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:37.758190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:37.769248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eb523-0a0f-4d2f-a898-1fe45d8fac26 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:37.826348 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:37.826907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:37.827187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:37.827461 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] PATH_INFO: `/v3/projects/c5e576ffa90d4118991edb48723664dc` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:37.828570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e576ffa90d4118991edb48723664dc)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:37.830563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:37.877843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e576ffa90d4118991edb48723664dc', 'request_id': 'req-adb0c835-e3c0-472d-944a-54b3380ebd13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.884945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e576ffa90d4118991edb48723664dc', 'request_id': 'req-adb0c835-e3c0-472d-944a-54b3380ebd13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.890394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e576ffa90d4118991edb48723664dc', 'request_id': 'req-adb0c835-e3c0-472d-944a-54b3380ebd13'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.900955 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] The token cache is being invalidate because project c5e576ffa90d4118991edb48723664dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:37.901264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.901888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:37.903357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1230/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:37 2022] DELETE /identity/v3/projects/c5e576ffa90d4118991edb48723664dc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:47.585656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:47.898077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:48.445024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:48.447002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:48.461796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304af73-a52c-4902-a7ef-87f5b8d6182a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:48.530172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:48.530813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:48.531098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:48.531385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] PATH_INFO: `/v3/users/3603342a11f14f3d9edd7dbcbf08d72d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:48.532512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3603342a11f14f3d9edd7dbcbf08d72d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:48.534973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:48.580465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3603342a11f14f3d9edd7dbcbf08d72d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.592154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3603342a11f14f3d9edd7dbcbf08d72d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.592824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3603342a11f14f3d9edd7dbcbf08d72d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.600263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3603342a11f14f3d9edd7dbcbf08d72d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.600885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bee4ad92-e5ed-4f10-8a38-9885f83fadc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3603342a11f14f3d9edd7dbcbf08d72d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.612900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1264/2494] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:48 2022] DELETE /identity/v3/users/3603342a11f14f3d9edd7dbcbf08d72d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:48.785525 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:48.787141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:48.800720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0c835-e3c0-472d-944a-54b3380ebd13 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:48.858446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:48.859001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:48.859279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:48.859673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] PATH_INFO: `/v3/projects/80b3167e7ad94627b239bf680217ff61` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:48.860794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b3167e7ad94627b239bf680217ff61)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:48.862745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:48.910087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b3167e7ad94627b239bf680217ff61', 'request_id': 'req-1e97bc50-baef-462b-b9e4-932be10def7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.917541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b3167e7ad94627b239bf680217ff61', 'request_id': 'req-1e97bc50-baef-462b-b9e4-932be10def7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.923167 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b3167e7ad94627b239bf680217ff61', 'request_id': 'req-1e97bc50-baef-462b-b9e4-932be10def7f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.934354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] The token cache is being invalidate because project 80b3167e7ad94627b239bf680217ff61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:48.934637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.935273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1e97bc50-baef-462b-b9e4-932be10def7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:48.936770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1231/2495] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:48 2022] DELETE /identity/v3/projects/80b3167e7ad94627b239bf680217ff61 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:48.941818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:48.942107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:48.942384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:48.962670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:48.963866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:49.024034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1265/2496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:49.031720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.032007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.032280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.052630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:49.054523 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:49.062464 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1232/2497] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:49.066761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.076223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b38df-342d-4363-a3c7-d59438d44fdd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.080769 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.081445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.081665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.081937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.082580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:15:49.082883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.084528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.097095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1266/2498] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:15:49.101961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.111064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141651b5-aaad-43fd-b7be-894e4dc898e0 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.115906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.117059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.117361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.117685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.118263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.120168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.148588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1233/2499] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:49 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:49.152895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.162622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc678a5-d8c5-49b1-b040-95fee4ec2166 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.166216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:49.223334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.223980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.224265 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.224562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.225189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.227329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.252389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1267/2500] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:49 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:49.253702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.267821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113d6f8-1766-4c1b-b704-fb65d06f36c2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.276315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.276993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.277382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.277772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.278566 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.280502 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.293285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1234/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:49.295673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.308297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aadbe-4aed-46ba-a6c0-496e39c8c5c3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.325398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.325398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.325398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.325398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.326116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.326116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5e2dc-afd8-470f-a34d-1e51337c879a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.330692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1268/2502] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:49.335228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.345402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6e79-f002-4527-ad80-5f65738ff090 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.350793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.351447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.351727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.352006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] PATH_INFO: `/v3/projects/e9ece065836845068b8b4dad1fa8076b/users/ad187f650db7465d95182481a5e07a8b/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.368077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ece065836845068b8b4dad1fa8076b, user_id=ad187f650db7465d95182481a5e07a8b, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.370836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.384417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1235/2503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:49 2022] PUT /identity/v3/projects/e9ece065836845068b8b4dad1fa8076b/users/ad187f650db7465d95182481a5e07a8b/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:49.389613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684563d4-ab2c-4f90-99cc-3aa82704bc5d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.389905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684563d4-ab2c-4f90-99cc-3aa82704bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.390182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684563d4-ab2c-4f90-99cc-3aa82704bc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.408937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-684563d4-ab2c-4f90-99cc-3aa82704bc5d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:49.410164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-684563d4-ab2c-4f90-99cc-3aa82704bc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:49.468290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1269/2504] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:49.478907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:49.480727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:49.512403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:49.540484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576f18-2ea4-4e7b-898b-02eb18a41f95 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:49.545032 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:49.545882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:49.546331 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:49.546659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:49.558583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:49.560131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:49.569958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1236/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:50.206714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.207236 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.207492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.242009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] MFA Rules not processed for user `ad187f650db7465d95182481a5e07a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:50.243239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:50.310626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1270/2506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:50.315056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.325090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962746-f2db-4a7a-8c4e-e502a11489f6 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.329683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.330265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.330574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.330845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.331463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.333451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.367115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1237/2507] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:50 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:50.370745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.395944 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf50314-47df-4991-ac6e-d2d757ecdc0f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.407287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:50.452766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.453404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.453683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.453953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.454572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.456757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.482548 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1271/2508] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:50 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:50.486796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.497921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418cb4-9fcc-497b-b104-5f1b05477fa0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.502543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.503140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.503418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.503691 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.504327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.505982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.516422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1238/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:50.520510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.530390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048839e8-9868-4fc7-a9e1-42b8a5edc1e6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.535176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.535939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.536257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.536515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] PATH_INFO: `/v3/projects/a86336ff74684a7299dfd31ee4053ebe/users/21e19d5e7ab247ecaf1e578dca9dfe96/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.551584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86336ff74684a7299dfd31ee4053ebe, user_id=21e19d5e7ab247ecaf1e578dca9dfe96, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.555587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.567794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1272/2510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:50 2022] PUT /identity/v3/projects/a86336ff74684a7299dfd31ee4053ebe/users/21e19d5e7ab247ecaf1e578dca9dfe96/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:15:50.571995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.581970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edaa47-603f-429a-b19b-e83fa610a9b9 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.638400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.639001 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.639311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.639581 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.640209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.641828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69f17-3a64-4374-b17f-f4f9af7a14c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.652194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1239/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:15:50.656252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:50.666932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc9ea2-3cb4-4e90-8d83-525283044f55 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:50.671460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:50.672092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:50.672370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:50.672640 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] PATH_INFO: `/v3/projects/a86336ff74684a7299dfd31ee4053ebe/users/21e19d5e7ab247ecaf1e578dca9dfe96/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:50.674556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86336ff74684a7299dfd31ee4053ebe, user_id=21e19d5e7ab247ecaf1e578dca9dfe96, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:50.677167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:50.687089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1273/2512] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:50 2022] PUT /identity/v3/projects/a86336ff74684a7299dfd31ee4053ebe/users/21e19d5e7ab247ecaf1e578dca9dfe96/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:51.309626 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:51.309921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:51.310201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:51.339514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] MFA Rules not processed for user `21e19d5e7ab247ecaf1e578dca9dfe96`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:51.340743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:51.413756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1240/2513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:52.754010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:52.818119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bcdd4-de40-499d-a2c6-87cb63b7401e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:52.823242 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:52.823859 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:52.824136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:52.824404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] PATH_INFO: `/v3/users/ad187f650db7465d95182481a5e07a8b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:52.825518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad187f650db7465d95182481a5e07a8b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:52.827422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:52.872717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad187f650db7465d95182481a5e07a8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:52.884985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad187f650db7465d95182481a5e07a8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:52.885672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad187f650db7465d95182481a5e07a8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:52.889143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:52.892835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad187f650db7465d95182481a5e07a8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:52.893651 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad187f650db7465d95182481a5e07a8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:52.907048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1274/2514] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:52 2022] DELETE /identity/v3/users/ad187f650db7465d95182481a5e07a8b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:53.130816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.142733 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e195c-75a4-4f0e-83b5-42e00ba368b4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:53.155774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:53.216205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:53.216834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.217113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.217417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] PATH_INFO: `/v3/projects/e9ece065836845068b8b4dad1fa8076b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.218516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ece065836845068b8b4dad1fa8076b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:53.220400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:53.265442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ece065836845068b8b4dad1fa8076b', 'request_id': 'req-ea247053-a8e3-43a8-8fad-89414e402abd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.275187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ece065836845068b8b4dad1fa8076b', 'request_id': 'req-ea247053-a8e3-43a8-8fad-89414e402abd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.281005 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ece065836845068b8b4dad1fa8076b', 'request_id': 'req-ea247053-a8e3-43a8-8fad-89414e402abd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.292453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] The token cache is being invalidate because project e9ece065836845068b8b4dad1fa8076b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:53.292738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.293393 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.294862 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1241/2515] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:53 2022] DELETE /identity/v3/projects/e9ece065836845068b8b4dad1fa8076b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:53.299040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.300395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:53.313583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07285-0cf3-436c-98b2-777acd51ff1c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:53.368874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:53.369552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.369833 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.370105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] PATH_INFO: `/v3/users/21e19d5e7ab247ecaf1e578dca9dfe96` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.371240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e19d5e7ab247ecaf1e578dca9dfe96)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:53.373149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:53.416180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e19d5e7ab247ecaf1e578dca9dfe96'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.427694 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e19d5e7ab247ecaf1e578dca9dfe96'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.428363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e19d5e7ab247ecaf1e578dca9dfe96'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.436529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e19d5e7ab247ecaf1e578dca9dfe96'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.437142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6bee8314-1a38-44c7-87d0-e73d9b6ece27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e19d5e7ab247ecaf1e578dca9dfe96'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.449028 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1275/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:53 2022] DELETE /identity/v3/users/21e19d5e7ab247ecaf1e578dca9dfe96 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:53.620008 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.622174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:53.636259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247053-a8e3-43a8-8fad-89414e402abd admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:53.693019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:53.693676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.693985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.694272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] PATH_INFO: `/v3/projects/a86336ff74684a7299dfd31ee4053ebe` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.695394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86336ff74684a7299dfd31ee4053ebe)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:53.697345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:53.742769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86336ff74684a7299dfd31ee4053ebe', 'request_id': 'req-766051af-5d66-4c31-8761-8f6f211eefe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.744438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:53.751023 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86336ff74684a7299dfd31ee4053ebe', 'request_id': 'req-766051af-5d66-4c31-8761-8f6f211eefe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.757795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86336ff74684a7299dfd31ee4053ebe', 'request_id': 'req-766051af-5d66-4c31-8761-8f6f211eefe6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.768801 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] The token cache is being invalidate because project a86336ff74684a7299dfd31ee4053ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:53.769093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.769765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-766051af-5d66-4c31-8761-8f6f211eefe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:53.771245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1242/2517] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:53 2022] DELETE /identity/v3/projects/a86336ff74684a7299dfd31ee4053ebe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:53.776691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.777195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.777324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.797844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:53.799032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:53.857153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1276/2518] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:53.865272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.865571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.865855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.885436 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:53.886623 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:53.894565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1243/2519] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:53.899133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.908573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb6172-5913-438d-8b67-c5cca5916393 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:53.913721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:53.914500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.914785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.915061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.915698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:15:53.915997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:53.917787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:53.919180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:53.930952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1277/2520] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:15:53.934964 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.944636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df98a-2310-474e-82a8-c5731c3075e8 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:53.949527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:53.950153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:53.950463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:53.950737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:53.951376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:53.953342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:53.979982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1244/2521] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:53 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:15:53.983957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:53.993916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef060-13e0-4e94-acff-f935e1e57e5e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.048453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.049011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.049371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.049613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.050247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.052201 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.072784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1278/2522] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:53 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:54.076855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.087594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075194c2-6f3a-4809-a5be-a33cf4f7ec25 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.092088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.092674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.092951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.093239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.093889 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.095465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.105156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1245/2523] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:54.109133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.119202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456e82-99ef-4e4c-a654-7607f10914d9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.123741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.124334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.124613 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.124913 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.125590 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.127175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c895-9c37-44c4-98e4-1c92914fd960 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.137937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1279/2524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:54.141902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.152459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0fadb-1f3d-4f0b-bdee-22418f281a27 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.157036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.157698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.157977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.158247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] PATH_INFO: `/v3/projects/d83dc4ebcae34b2c87b17c8c35db75be/users/4cd6f2651e174ad9b3b549ceb53055b0/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.172399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83dc4ebcae34b2c87b17c8c35db75be, user_id=4cd6f2651e174ad9b3b549ceb53055b0, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.175080 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.187386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1246/2525] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:54 2022] PUT /identity/v3/projects/d83dc4ebcae34b2c87b17c8c35db75be/users/4cd6f2651e174ad9b3b549ceb53055b0/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:15:54.198067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.198426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.198770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.227197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] MFA Rules not processed for user `4cd6f2651e174ad9b3b549ceb53055b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:54.228418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:54.296863 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1280/2526] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:54.301419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.367573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24e88-8a87-4b08-94d9-cdd64863715c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.372326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.372942 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.373240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.373527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.374181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.376097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.407255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1247/2527] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:54 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:15:54.411484 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.422971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ad155-84dd-4787-8ffa-7540960b9ee0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.484328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.485599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.485887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.486164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.486840 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.488864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.498693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:54.513970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1281/2528] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:54 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:54.518165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.529519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3306cba-4ccb-4b11-a598-d45106dedcca admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.534266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.534947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.535297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.535642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.536391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.538745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.550407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1248/2529] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:54.555380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.565495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb5b8-ccb3-42a4-b61f-18a111b33c75 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.570202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.570857 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.571137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.571440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] PATH_INFO: `/v3/projects/6de651cde857410eb1983cd901e79c4d/users/5c6b91c98c3342fd92337ea96839e9e7/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.589203 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de651cde857410eb1983cd901e79c4d, user_id=5c6b91c98c3342fd92337ea96839e9e7, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.591906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.606337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1282/2530] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:54 2022] PUT /identity/v3/projects/6de651cde857410eb1983cd901e79c4d/users/5c6b91c98c3342fd92337ea96839e9e7/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:54.610467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.620678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4af496-bc8e-4de1-9c0d-9e1e126bbabc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.668300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:54.680856 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.681486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.681764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.682031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.682661 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.684241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51060344-1289-4677-8992-43a790ea8c20 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.693565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1249/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:54.698293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.708406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5014b-4f17-40c7-af10-08003a84b7f1 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.713593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.714232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.714510 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.714784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] PATH_INFO: `/v3/projects/6de651cde857410eb1983cd901e79c4d/users/5c6b91c98c3342fd92337ea96839e9e7/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.716660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de651cde857410eb1983cd901e79c4d, user_id=5c6b91c98c3342fd92337ea96839e9e7, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.719309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.729439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1283/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:54 2022] PUT /identity/v3/projects/6de651cde857410eb1983cd901e79c4d/users/5c6b91c98c3342fd92337ea96839e9e7/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:54.740990 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.741306 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.741580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.770643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] MFA Rules not processed for user `5c6b91c98c3342fd92337ea96839e9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:54.771921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:54.838940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1250/2533] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:54.850225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:54.851983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:54.907734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d94a2-453d-4b9d-8543-d8adf8dceba0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:54.913100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:54.913727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:54.914013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:54.914282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:54.929777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:54.931217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ccf76-67c0-4a03-9418-849d17e7a9f2 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:54.940501 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1284/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:54.969945 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:55.031084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89f4b-c6d4-45df-9ae2-bc569e88b8dd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:55.035645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:55.036265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:55.036574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:55.036849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] PATH_INFO: `/v3/users/4cd6f2651e174ad9b3b549ceb53055b0` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:55.038037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd6f2651e174ad9b3b549ceb53055b0)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:55.039951 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:55.083735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd6f2651e174ad9b3b549ceb53055b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.096274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd6f2651e174ad9b3b549ceb53055b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.104197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd6f2651e174ad9b3b549ceb53055b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.104905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd6f2651e174ad9b3b549ceb53055b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.105538 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd6f2651e174ad9b3b549ceb53055b0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.106755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:55.121084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1251/2535] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:54 2022] DELETE /identity/v3/users/4cd6f2651e174ad9b3b549ceb53055b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:55.125713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:55.125998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:55.126268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:55.145772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:55.146995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:55.206758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1285/2536] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:55.216435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:55.217898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:55.273727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68bf19-041e-42aa-a010-c8f8802ad34c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:55.277330 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:55.277921 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:55.278198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:55.278467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:55.287096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:55.288575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:55.297810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1252/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:55.557675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:55.559107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:55.579234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b82477-917e-4786-b188-d8c63d2184ac None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:55.586320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:55.586954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:55.587232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:55.587504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] PATH_INFO: `/v3/projects/d83dc4ebcae34b2c87b17c8c35db75be` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:55.588612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83dc4ebcae34b2c87b17c8c35db75be)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:55.590582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:55.640014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83dc4ebcae34b2c87b17c8c35db75be', 'request_id': 'req-05ef3565-7673-4439-aaf0-874c73d2bee8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.641956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:55.647049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83dc4ebcae34b2c87b17c8c35db75be', 'request_id': 'req-05ef3565-7673-4439-aaf0-874c73d2bee8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.654920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83dc4ebcae34b2c87b17c8c35db75be', 'request_id': 'req-05ef3565-7673-4439-aaf0-874c73d2bee8'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.668403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] The token cache is being invalidate because project d83dc4ebcae34b2c87b17c8c35db75be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:55.668696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.669357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.670874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1286/2538] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:55 2022] DELETE /identity/v3/projects/d83dc4ebcae34b2c87b17c8c35db75be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:55.674986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:55.685719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650757-c32f-4fe3-a4a2-24782956078d service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:55.743537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:55.744179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:55.744467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:55.744750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] PATH_INFO: `/v3/users/5c6b91c98c3342fd92337ea96839e9e7` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:55.745944 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6b91c98c3342fd92337ea96839e9e7)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:55.747917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:55.796058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6b91c98c3342fd92337ea96839e9e7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.809123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6b91c98c3342fd92337ea96839e9e7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.816829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6b91c98c3342fd92337ea96839e9e7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.817482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6b91c98c3342fd92337ea96839e9e7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.818097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-fd7bac12-e869-4cc1-aa3d-5db143f26288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6b91c98c3342fd92337ea96839e9e7'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:55.830114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1253/2539] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:55 2022] DELETE /identity/v3/users/5c6b91c98c3342fd92337ea96839e9e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:56.096087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.097721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:56.113572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3565-7673-4439-aaf0-874c73d2bee8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.173113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.173823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.174052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.174327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] PATH_INFO: `/v3/projects/6de651cde857410eb1983cd901e79c4d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.175418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de651cde857410eb1983cd901e79c4d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.177387 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.221409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de651cde857410eb1983cd901e79c4d', 'request_id': 'req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:56.226706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de651cde857410eb1983cd901e79c4d', 'request_id': 'req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:56.232620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de651cde857410eb1983cd901e79c4d', 'request_id': 'req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:56.245141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] The token cache is being invalidate because project 6de651cde857410eb1983cd901e79c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:56.245450 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:56.246087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-bf0ad371-8642-49d3-a12f-1a9fa7e1decb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:56.247543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1287/2540] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:56 2022] DELETE /identity/v3/projects/6de651cde857410eb1983cd901e79c4d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:56.252452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.252937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.253050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.274446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:56.275690 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:56.281129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:56.335342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1254/2541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:56.343111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.343394 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.343667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.362983 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:56.364184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:56.372258 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1288/2542] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:56.376239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.386297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddcbf-9866-4735-948d-80ae66646260 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.390789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.391368 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.391645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.391918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.392551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:15:56.392853 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.394475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.406686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1255/2543] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:15:56.410400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.419275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d590fd9-5c8c-45c2-aae6-35f3cef1b851 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.423931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.424462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.424745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.425020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.425697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.427600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.456902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1289/2544] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:56.458014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.468317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b0ef-c9b0-429a-b8e2-b7c269a740a6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.523637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.524175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.524460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.524735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.525396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.527321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.549399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1256/2545] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:56.551822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.562001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cefe33-d097-4963-95fd-d6042d47f73c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.566593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.567186 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.567471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.567750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.568388 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.570561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.580229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1290/2546] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:56.584136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.594693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23042d-d4b1-4d73-ab50-53503d80ef01 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.599506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.600096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.600374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.600647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.601350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.602970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e82d1-ab7b-4f2f-a930-467b2eb9004c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.613360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1257/2547] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:56.617992 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.627635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318335a9-bb0d-4f10-a5da-2f8d75091056 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.632822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.633498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.633785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.634067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] PATH_INFO: `/v3/projects/6bcc7051d034449c9b901b8d788572a8/users/db45241faab14aa18fba8e1d1a7b1e5d/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.649013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcc7051d034449c9b901b8d788572a8, user_id=db45241faab14aa18fba8e1d1a7b1e5d, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.651690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:56.664818 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1291/2548] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:56 2022] PUT /identity/v3/projects/6bcc7051d034449c9b901b8d788572a8/users/db45241faab14aa18fba8e1d1a7b1e5d/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:15:56.675176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.675699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.675981 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.706086 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] MFA Rules not processed for user `db45241faab14aa18fba8e1d1a7b1e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:56.707293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:56.895319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1258/2549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:56.900289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:56.908814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:56.964784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf824d-1cd0-4ee7-a52c-31ef0abcb34e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:56.969684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:56.970294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:56.970580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:56.970860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:56.971491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:56.973487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.000782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1292/2550] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:56 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:57.004705 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.015556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4abc4-1b35-4095-a329-51a2165aa946 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.019104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:57.071586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.072180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.072459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.072729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.073388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.075304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.095984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1259/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:57 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:57.100225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.110393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317c34-332d-4246-a66b-a14bbf934aba admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.115209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.115802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.116085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.116361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.117004 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.118636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.128911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1293/2552] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:57.133403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.146179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2001-3e9f-422c-bc3b-c41a821eb04a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.152758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.153447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.153721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.153994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] PATH_INFO: `/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1/users/905e2472b18242cb934d350ed3ab3d22/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.170739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d8b43b2bd9449eac2661bf6513f9b1, user_id=905e2472b18242cb934d350ed3ab3d22, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.173488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.186172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1260/2553] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:57 2022] PUT /identity/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1/users/905e2472b18242cb934d350ed3ab3d22/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:57.190085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.200259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943658e-9ef4-4b2c-a02c-25318c5c959b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.255303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.255917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.256200 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.257005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.257717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.259317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27c37-2035-4f43-977c-acb3cf6818ae admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.268865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1294/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:57.273698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.283937 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67dac6-f327-4c43-a0f4-9cd625583b7b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.288481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.289115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.289425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.289702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] PATH_INFO: `/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1/users/905e2472b18242cb934d350ed3ab3d22/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.291601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d8b43b2bd9449eac2661bf6513f9b1, user_id=905e2472b18242cb934d350ed3ab3d22, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.294266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.304229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1261/2555] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:57 2022] PUT /identity/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1/users/905e2472b18242cb934d350ed3ab3d22/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:15:57.315402 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.315691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.315972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.344113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] MFA Rules not processed for user `905e2472b18242cb934d350ed3ab3d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:57.345357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:57.412152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1295/2556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:57.422841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.424495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:57.480963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25c7a0-bc80-497d-94e4-039a20fa267c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.484769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.485395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.485666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.486247 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.496146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.497600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e550f3-55ce-4ef4-b0f8-93acad5b89f6 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.507702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1262/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:57.872730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:57.876906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:57.934597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c2f7-a8a6-4e9a-8d66-649327b2bacc None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:57.939153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:57.939801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:57.940089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:57.940365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] PATH_INFO: `/v3/users/db45241faab14aa18fba8e1d1a7b1e5d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:57.941537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db45241faab14aa18fba8e1d1a7b1e5d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:57.943457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:57.987578 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db45241faab14aa18fba8e1d1a7b1e5d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.000852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db45241faab14aa18fba8e1d1a7b1e5d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.001573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db45241faab14aa18fba8e1d1a7b1e5d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.008894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db45241faab14aa18fba8e1d1a7b1e5d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.009523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db45241faab14aa18fba8e1d1a7b1e5d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.021902 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1296/2558] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:57 2022] DELETE /identity/v3/users/db45241faab14aa18fba8e1d1a7b1e5d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:58.026325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:58.026614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:58.026982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:58.046002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:58.047196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:58.109631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1263/2559] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:58.120566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:58.122020 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:58.184152 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54ed18-c3de-4d12-af03-92424f26d819 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:58.187748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:58.188349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:58.188627 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:58.188900 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:58.198169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:58.199577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:58.208711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1297/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:15:58.469627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:58.471104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:58.478966 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:58.486087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c798-8795-40f2-a9ea-251e7043e415 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:58.492846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:58.493750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:58.494034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:58.494307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] PATH_INFO: `/v3/projects/6bcc7051d034449c9b901b8d788572a8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:58.495429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcc7051d034449c9b901b8d788572a8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:58.497637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:58.543907 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcc7051d034449c9b901b8d788572a8', 'request_id': 'req-5103c683-2e3a-456a-837f-2db4a2c4daf0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.551092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcc7051d034449c9b901b8d788572a8', 'request_id': 'req-5103c683-2e3a-456a-837f-2db4a2c4daf0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.558571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcc7051d034449c9b901b8d788572a8', 'request_id': 'req-5103c683-2e3a-456a-837f-2db4a2c4daf0'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.569353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] The token cache is being invalidate because project 6bcc7051d034449c9b901b8d788572a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:58.569634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.570277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.571722 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1264/2561] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:58 2022] DELETE /identity/v3/projects/6bcc7051d034449c9b901b8d788572a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:58.575820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:58.585391 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756ed0-e194-4fb7-9a82-a6b4ecf4bdb4 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:58.604706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:58.642472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:58.643024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:58.643306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:58.643581 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] PATH_INFO: `/v3/users/905e2472b18242cb934d350ed3ab3d22` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:58.644703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] RBAC: Authorizing `identity:delete_user(user_id=905e2472b18242cb934d350ed3ab3d22)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:58.646667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:58.690989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905e2472b18242cb934d350ed3ab3d22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.702445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905e2472b18242cb934d350ed3ab3d22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.703090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905e2472b18242cb934d350ed3ab3d22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.710079 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905e2472b18242cb934d350ed3ab3d22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.710684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-c0c53078-500f-42e6-b19f-5dd7d029f47e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905e2472b18242cb934d350ed3ab3d22'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:58.722834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1298/2562] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:15:58 2022] DELETE /identity/v3/users/905e2472b18242cb934d350ed3ab3d22 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:58.988539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:58.990370 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:59.003251 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c683-2e3a-456a-837f-2db4a2c4daf0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.060497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.061126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.061440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.061719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] PATH_INFO: `/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.062830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d8b43b2bd9449eac2661bf6513f9b1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.064734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.110353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d8b43b2bd9449eac2661bf6513f9b1', 'request_id': 'req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:59.117496 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d8b43b2bd9449eac2661bf6513f9b1', 'request_id': 'req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:59.122794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d8b43b2bd9449eac2661bf6513f9b1', 'request_id': 'req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:59.133286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] The token cache is being invalidate because project d2d8b43b2bd9449eac2661bf6513f9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:15:59.133605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:59.134325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-4fbdc4fb-6dcb-4a6c-9451-9a90f04dd72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:15:59.135868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1265/2563] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:15:58 2022] DELETE /identity/v3/projects/d2d8b43b2bd9449eac2661bf6513f9b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:15:59.140674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.141161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.141383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.161619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:59.163429 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:59.225757 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1299/2564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:59.233297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.233589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.233866 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.254673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:59.256099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:59.264534 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1266/2565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:59.268829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.279214 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7add0-278d-41a9-be49-45a172ba77d3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.284367 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.284971 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.285275 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.285556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.286208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:15:59.286515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.288160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.300090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1300/2566] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:15:59.304230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.313217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aed048-3691-408b-8613-7868d2f12a74 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.317873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.318463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.319408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.319683 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.320341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.322273 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.331788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:59.353265 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1267/2567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:59.355580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.365918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abb823-bed8-4fea-8b2d-f7de512636fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.394213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:15:59.422889 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.423480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.423759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.424029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.424639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.426556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.446917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1301/2568] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:15:59 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:15:59.451186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.461193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b755-ed24-4ccb-90a4-dfe0454fa7ed admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.466283 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.466875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.468304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.468304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.468304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.469636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.481136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1268/2569] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:59.485403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.495591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77665d-f3ae-4a92-8f90-f253d3987b12 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.500129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.500717 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.500998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.501301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.501942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.503529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a437-b22f-48d6-884a-bfa324f83c48 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.513722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1302/2570] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:15:59.517648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.527810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebb8d-4f0c-4bfa-bc40-b59840f4dd35 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.532284 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.532911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.533187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.533489 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] PATH_INFO: `/v3/projects/8ad97f408ae04ed294a9144f4c5eb69c/users/7b2a3a989e874a3b9fe0b216207d8292/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.547352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad97f408ae04ed294a9144f4c5eb69c, user_id=7b2a3a989e874a3b9fe0b216207d8292, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.549986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.562924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1269/2571] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:15:59 2022] PUT /identity/v3/projects/8ad97f408ae04ed294a9144f4c5eb69c/users/7b2a3a989e874a3b9fe0b216207d8292/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:15:59.568022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e448-770f-40cb-811e-7c62703eefae None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.568315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e448-770f-40cb-811e-7c62703eefae None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.568595 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e448-770f-40cb-811e-7c62703eefae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.588378 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3619e448-770f-40cb-811e-7c62703eefae None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:15:59.589606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3619e448-770f-40cb-811e-7c62703eefae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:59.647478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1303/2572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:15:59.657071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:15:59.658804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:15:59.715034 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce1df1-d74a-4afc-876f-f31d83b73f7f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:15:59.718702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:15:59.719324 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:15:59.719600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:15:59.719868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:15:59.729773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:15:59.731223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:15:59.740549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1270/2573] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:00.350531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.351109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.351109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.382814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] MFA Rules not processed for user `7b2a3a989e874a3b9fe0b216207d8292`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:00.384025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:00.456109 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1304/2574] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:00.461949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.472617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec1ff4-31b7-4c2a-ac60-5ba52d4c7273 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.477419 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.478249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.478530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.478807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.479438 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.481408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.512564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1271/2575] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:16:00 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:16:00.516404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.531073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f963-09c9-4953-b246-0be6afee0578 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.579616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:00.597990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.598596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.598874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.599146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.599761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.601772 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.623569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1305/2576] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:16:00 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:16:00.627055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.637807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462adc3-edbe-49e0-a435-136066fd8e61 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.642357 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.642947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.643228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.643503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.644178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.645804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.656028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1272/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:00.660204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.670162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8643e-5cb0-4256-b22b-326a3cdbf192 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.674737 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.675379 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.675665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.675945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] PATH_INFO: `/v3/projects/2edd2642b8344869b7b77269542faca5/users/7b321150a7294d52be01cb78ffeab787/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.690733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd2642b8344869b7b77269542faca5, user_id=7b321150a7294d52be01cb78ffeab787, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.693428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.706822 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1306/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:16:00 2022] PUT /identity/v3/projects/2edd2642b8344869b7b77269542faca5/users/7b321150a7294d52be01cb78ffeab787/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:00.710874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.720655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd5dd9-c74f-4c60-9777-946bf8394b2f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.779875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.780483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.780767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.781041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.781721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.783335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae893d-1945-4273-90e4-119077666d4b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.793727 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1273/2579] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:00.797930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:00.808867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8354c76-0c24-4620-94d3-57f057eaeafe admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:00.813489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:00.814135 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:00.814419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:00.814699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] PATH_INFO: `/v3/projects/2edd2642b8344869b7b77269542faca5/users/7b321150a7294d52be01cb78ffeab787/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:00.816910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edd2642b8344869b7b77269542faca5, user_id=7b321150a7294d52be01cb78ffeab787, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:00.820057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2500ef0-c4c2-408e-ab98-a339185d2f13 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:00.830212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1307/2580] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:16:00 2022] PUT /identity/v3/projects/2edd2642b8344869b7b77269542faca5/users/7b321150a7294d52be01cb78ffeab787/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:01.435919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:01.436260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:01.436550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:01.464678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] MFA Rules not processed for user `7b321150a7294d52be01cb78ffeab787`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:01.466038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:01.471191 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:01.540164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1274/2581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:01.550653 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab15c-d4b7-40d8-8895-c6af2b53c629 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:01.551110 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab15c-d4b7-40d8-8895-c6af2b53c629 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:01.551233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab15c-d4b7-40d8-8895-c6af2b53c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:01.572261 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-149ab15c-d4b7-40d8-8895-c6af2b53c629 None None] MFA Rules not processed for user `7b2a3a989e874a3b9fe0b216207d8292`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:01.573171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-149ab15c-d4b7-40d8-8895-c6af2b53c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:01.633306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1308/2582] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:01.644485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:01.645952 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:01.721477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce5240-c9a1-4725-8313-2e23a70cac68 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:01.727537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:01.728150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:01.728432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:01.728708 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:01.736418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:01.738046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:01.747589 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1275/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:04.569891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:04.570276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:04.570442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:04.598256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:04.599536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:04.677564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1309/2584] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:04.727500 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:04.729056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:04.805569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95884-89a4-462c-a72b-2e266115d9b9 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:04.810475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:04.811072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:04.811354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:04.811631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:04.820193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:04.821825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:04.829794 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1276/2585] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:16:14.670722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:14.826569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:15.153158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:15.154556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:15.234996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5c84-764b-4310-ae74-58b8c7cacc93 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:15.239766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:15.242307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:15.242905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:15.244053 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:15.265392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:15.266869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c787b12-c387-4a55-87c0-2603426bf2b9 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:15.289466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1310/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:16.036270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:16.038343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:16.094277 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f4cdd-31fd-4199-88c9-fd79a0d095d6 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:16.097806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:16.098395 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:16.098669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:16.098936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:16.101310 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:16.114125 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:16.115775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:16.126190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1277/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:18.335962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a0a1-7c99-4f8a-9f44-a55e669765d2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:18.336448 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a0a1-7c99-4f8a-9f44-a55e669765d2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:18.336563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a0a1-7c99-4f8a-9f44-a55e669765d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:18.355356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2a21a0a1-7c99-4f8a-9f44-a55e669765d2 None None] MFA Rules not processed for user `5fca6a15a17c423393582da43abec450`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:18.356547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2a21a0a1-7c99-4f8a-9f44-a55e669765d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:18.414284 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1311/2588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:18.453289 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:18.454897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:18.514278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90204-0b8b-4e13-985a-0d2d56d85e10 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:18.519302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:18.520400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:18.520910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:18.521193 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:18.522991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:18.539154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:18.540771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373c045-91ae-4873-986e-239338ea2e0d service glance] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:18.553486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1278/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:20.029572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689e46-153c-4330-896b-2751239465bd None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.030488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689e46-153c-4330-896b-2751239465bd None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.030934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689e46-153c-4330-896b-2751239465bd None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.032755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1312/2590] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:16:20.054208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd00ea-a9cf-41a2-8ad5-4564bdbabff6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.054788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd00ea-a9cf-41a2-8ad5-4564bdbabff6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.055117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd00ea-a9cf-41a2-8ad5-4564bdbabff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.078004 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4dcd00ea-a9cf-41a2-8ad5-4564bdbabff6 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:20.079476 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4dcd00ea-a9cf-41a2-8ad5-4564bdbabff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:20.089457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1279/2591] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:20.102244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689e46-153c-4330-896b-2751239465bd None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:20.116979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689e46-153c-4330-896b-2751239465bd None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:20.121359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:20.122043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.122545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.122825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.134585 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:20.136480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6d17e-3981-4601-b0b0-6e5f81f1c5d6 service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:20.147988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1313/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:20.219916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f899-afd4-4ad4-a0ce-387bb99aad9d None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.220209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f899-afd4-4ad4-a0ce-387bb99aad9d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.220472 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3f899-afd4-4ad4-a0ce-387bb99aad9d None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.221845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1280/2593] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:16:20.227433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314a1-58de-41b6-91da-19ff10e7bb2e None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.227764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314a1-58de-41b6-91da-19ff10e7bb2e None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.228038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477314a1-58de-41b6-91da-19ff10e7bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.248729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-477314a1-58de-41b6-91da-19ff10e7bb2e None None] MFA Rules not processed for user `33c4e0b235524e84b0d003e7dfdb00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:20.249989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-477314a1-58de-41b6-91da-19ff10e7bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:20.256734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1314/2594] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:20.268724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3f899-afd4-4ad4-a0ce-387bb99aad9d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:20.279588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3f899-afd4-4ad4-a0ce-387bb99aad9d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:20.283149 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:20.283847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.284130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.284411 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.292234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:20.293724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9459026-49c8-4a52-8985-a08831fb06fa service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:20.301497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1281/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:20.383393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ba18-2e1b-430f-9340-2fa9a7ea86e3 None None] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.383684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ba18-2e1b-430f-9340-2fa9a7ea86e3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.383963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74ba18-2e1b-430f-9340-2fa9a7ea86e3 None None] PATH_INFO: `/` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.385346 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1315/2596] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 14:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:16:20.390738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cfa-9737-4508-af1c-6a0856b3d086 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.391026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cfa-9737-4508-af1c-6a0856b3d086 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.391317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cfa-9737-4508-af1c-6a0856b3d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.410556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2e236cfa-9737-4508-af1c-6a0856b3d086 None None] MFA Rules not processed for user `0984655bd84440f0b4baf516e7be88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:20.412287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2e236cfa-9737-4508-af1c-6a0856b3d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:20.421620 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1282/2597] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:20.432638 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74ba18-2e1b-430f-9340-2fa9a7ea86e3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:20.444995 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74ba18-2e1b-430f-9340-2fa9a7ea86e3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:20.448742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:20.449382 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:20.449695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:20.449965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:20.460393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:20.461886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:20.473040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1316/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:22.307257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:22.307785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:22.307785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:22.331181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:22.332364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:22.341826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1283/2599] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:22.355791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:22.369058 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea955-fc33-4911-9127-518d5402b04c service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:22.380307 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:22.381016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:22.381399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:22.381731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:22.391767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:22.393683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735b30f-e2e4-438f-aa11-ac03863227b6 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:22.404095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1317/2600] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:16:26.034179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:26.036391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:26.059287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb51d59-46ee-4bc3-9a02-27b15121995c None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:26.065378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:26.066115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:26.066522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:26.066893 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:26.068803 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:26.136386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:26.138201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:26.149602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1284/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:32.399916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=72 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:35.894180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:35.894765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:35.894765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:35.916406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:35.917654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:35.925580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1318/2602] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:35.937126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:35.948806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78164-290d-4c99-a9fe-dd9f58b820c5 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:35.953791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:35.954418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:35.954734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:35.955007 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:35.963625 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:35.965202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:35.968720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:35.975109 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1285/2603] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:16:36.764066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:36.776044 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73458c6b-ef51-42b0-9028-af1c08dcaba6 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:36.779751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:36.780357 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:36.780637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:36.780908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:36.782678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:36.793269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:36.794990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:36.803660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1319/2604] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:37.039911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:37.105364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e35d9-471d-42ca-9ab2-42fe73122399 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:37.110111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:37.110738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:37.111022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:37.111301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] PATH_INFO: `/v3/users/7b2a3a989e874a3b9fe0b216207d8292` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:37.112432 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2a3a989e874a3b9fe0b216207d8292)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:37.114677 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:37.159665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2a3a989e874a3b9fe0b216207d8292'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.171614 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2a3a989e874a3b9fe0b216207d8292'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.178377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2a3a989e874a3b9fe0b216207d8292'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.179046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2a3a989e874a3b9fe0b216207d8292'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.179699 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2a3a989e874a3b9fe0b216207d8292'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.191958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1286/2605] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:16:37 2022] DELETE /identity/v3/users/7b2a3a989e874a3b9fe0b216207d8292 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:37.368598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:37.385611 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927b5a4-db25-45d1-a8c3-c5463a54a70f service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:37.453370 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:37.454013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:37.454291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:37.454559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] PATH_INFO: `/v3/projects/8ad97f408ae04ed294a9144f4c5eb69c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:37.455687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad97f408ae04ed294a9144f4c5eb69c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:37.458352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:37.504330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad97f408ae04ed294a9144f4c5eb69c', 'request_id': 'req-0092fb74-5b5e-47af-969e-8d46d11fa3ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.510571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad97f408ae04ed294a9144f4c5eb69c', 'request_id': 'req-0092fb74-5b5e-47af-969e-8d46d11fa3ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.516606 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad97f408ae04ed294a9144f4c5eb69c', 'request_id': 'req-0092fb74-5b5e-47af-969e-8d46d11fa3ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.529534 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] The token cache is being invalidate because project 8ad97f408ae04ed294a9144f4c5eb69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:16:37.529824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.530466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.531949 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1320/2606] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:16:37 2022] DELETE /identity/v3/projects/8ad97f408ae04ed294a9144f4c5eb69c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:37.535948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:37.537454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:37.550126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff7bc7-60b2-4886-a716-475b2fb67cf4 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:37.614948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:37.615584 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:37.615868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:37.616146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] PATH_INFO: `/v3/users/7b321150a7294d52be01cb78ffeab787` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:37.617338 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b321150a7294d52be01cb78ffeab787)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:37.619264 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:37.640726 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:37.666572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b321150a7294d52be01cb78ffeab787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.678362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b321150a7294d52be01cb78ffeab787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.686242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b321150a7294d52be01cb78ffeab787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.686892 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b321150a7294d52be01cb78ffeab787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.687504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b2050eed-36e7-4fba-b6ca-461bb4940e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b321150a7294d52be01cb78ffeab787'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:37.700099 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1287/2607] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:16:37 2022] DELETE /identity/v3/users/7b321150a7294d52be01cb78ffeab787 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:37.871954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:37.873761 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:37.889436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092fb74-5b5e-47af-969e-8d46d11fa3ae admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:37.953095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:37.953669 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:37.953953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:37.954230 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] PATH_INFO: `/v3/projects/2edd2642b8344869b7b77269542faca5` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:37.955336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edd2642b8344869b7b77269542faca5)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:37.957247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:37.968354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:38.003433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edd2642b8344869b7b77269542faca5', 'request_id': 'req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:38.009674 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edd2642b8344869b7b77269542faca5', 'request_id': 'req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:38.015577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edd2642b8344869b7b77269542faca5', 'request_id': 'req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:38.029625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] The token cache is being invalidate because project 2edd2642b8344869b7b77269542faca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:16:38.029915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:38.030559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-b4b1e1c3-f2d5-4fae-9dfb-e85932dbda78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:38.032067 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1321/2608] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:16:37 2022] DELETE /identity/v3/projects/2edd2642b8344869b7b77269542faca5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:38.037828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.038124 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.038391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.057793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:38.058969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:38.115065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1288/2609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:38.122787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.123103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.123393 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.147938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:38.149198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:38.157414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1322/2610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:16:38.161600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.170989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00bbb-4dd4-4b11-8500-b554ab318576 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.175616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.176901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.177361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.177698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.178700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:16:38.179207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.181006 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.193305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1289/2611] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:16:38.197515 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.207115 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3dcf-5668-4b9a-95dd-ef93f97f542d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.212530 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.213137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.213454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.213733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.214439 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.216365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.245748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1323/2612] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:16:38.250121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.259790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14d99-2ef1-42ed-9ee8-0deea274dc37 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.314092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.314682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.314961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.315227 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.315869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.318334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.339263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1290/2613] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:16:38 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:16:38.343291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.353443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07525d8b-334c-4404-abe6-de7ef352f87a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.358047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.358637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.358927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.359195 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.359831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.361466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.371363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1324/2614] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:38.375048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.385687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d8562-e027-42fc-b484-d39a571cda25 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.390285 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.390868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.391154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.391433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.392069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.393685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be92fc-c530-4e58-84b7-7445c2d0de9f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.404678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1291/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:38.408592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.418600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e1df-7b01-41c1-bfaa-b0f6b16d6e92 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.423141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.423785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.424071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.424354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] PATH_INFO: `/v3/projects/a32808d0ef8b4ab1bd61277ce1655de0/users/9ca24a55107d4cdbb4a396f7073f1704/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.439443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32808d0ef8b4ab1bd61277ce1655de0, user_id=9ca24a55107d4cdbb4a396f7073f1704, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.442654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.454814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1325/2616] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:16:38 2022] PUT /identity/v3/projects/a32808d0ef8b4ab1bd61277ce1655de0/users/9ca24a55107d4cdbb4a396f7073f1704/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:38.465682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.465911 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.466183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.473118 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:38.497033 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] MFA Rules not processed for user `9ca24a55107d4cdbb4a396f7073f1704`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:38.500145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:38.568601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1292/2617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:38.579906 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:38.581790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:38.639209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4605-f6e5-4cc2-a9df-fc64ca6b1d00 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:38.642903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:38.643506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:38.643788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:38.644099 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:38.652621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:38.654089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d44ef-5dde-4029-ad45-512179f9c495 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:38.662941 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1326/2618] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:48.564901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=31 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:48.670022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:50.417403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:50.477730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49160-3980-4a21-a6b8-a18840b02b32 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:50.482978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:50.483609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:50.483884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:50.484154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] PATH_INFO: `/v3/users/9ca24a55107d4cdbb4a396f7073f1704` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:50.485425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca24a55107d4cdbb4a396f7073f1704)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:50.487571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:50.534504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca24a55107d4cdbb4a396f7073f1704'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:50.546351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca24a55107d4cdbb4a396f7073f1704'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:50.554060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca24a55107d4cdbb4a396f7073f1704'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:50.554854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca24a55107d4cdbb4a396f7073f1704'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:50.555475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca24a55107d4cdbb4a396f7073f1704'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:50.570949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1293/2619] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:16:50 2022] DELETE /identity/v3/users/9ca24a55107d4cdbb4a396f7073f1704 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:50.575361 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:50.575861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:50.575969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:50.595158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:50.596352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:50.653703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1327/2620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:50.663886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:50.665334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:50.720117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a5e0-5123-46f3-8b7a-334f26e99987 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:50.724299 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:50.724888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:50.725164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:50.725468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:50.734645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:50.736063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b6d9-1896-4c5d-ab0b-620b673a0526 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:50.746426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1294/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:16:51.009984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.011409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:51.024002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607dd3-7e80-43fe-8314-eddaa026ef61 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.028639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.029311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.029588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.029934 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] PATH_INFO: `/v3/projects/a32808d0ef8b4ab1bd61277ce1655de0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.031343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32808d0ef8b4ab1bd61277ce1655de0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.033327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.080931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32808d0ef8b4ab1bd61277ce1655de0', 'request_id': 'req-f4b5b6f0-3263-4699-95b9-e6a64fa01469'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:51.086459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32808d0ef8b4ab1bd61277ce1655de0', 'request_id': 'req-f4b5b6f0-3263-4699-95b9-e6a64fa01469'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:51.092554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32808d0ef8b4ab1bd61277ce1655de0', 'request_id': 'req-f4b5b6f0-3263-4699-95b9-e6a64fa01469'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:51.105441 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] The token cache is being invalidate because project a32808d0ef8b4ab1bd61277ce1655de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:16:51.105730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:51.106348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-f4b5b6f0-3263-4699-95b9-e6a64fa01469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:16:51.107837 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1328/2622] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:16:51 2022] DELETE /identity/v3/projects/a32808d0ef8b4ab1bd61277ce1655de0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:51.112639 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.112931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.113211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.133077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:51.134314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:51.150886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:51.195519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1295/2623] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:51.256085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.256375 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.256656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.276171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:51.277433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:51.285708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1329/2624] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:16:51.290253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.299731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e024e-1f10-4f92-918f-fc76a1373c54 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.304796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.305416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.305696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.305965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.306601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:16:51.306897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.308468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.320021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1296/2625] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:16:51.324084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.333828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b371f7-335e-432a-82c7-0d4624b64902 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.338392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.338973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.339250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.339517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.340143 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.342087 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.368687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1330/2626] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:16:51 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:16:51.372666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.383234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce49353-b116-426f-972f-d7828ad17bab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.437048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.437730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.437997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.438205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.438877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.440786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.465002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1297/2627] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:16:51 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:16:51.469085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.479156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083ab0a-cee7-4c9e-b667-69409ae5997f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.483688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.484283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.484566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.484842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.485522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.487124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.497622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1331/2628] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:51.501424 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.511684 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28368ea-6414-40f4-be34-68da0950460f admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.516199 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.516778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.517058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.517366 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.518002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.519572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85cb60-13a4-4c01-9ec5-c21ebcaa2be6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.529855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1298/2629] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:16:51.533758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.543684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891764c-3b87-465e-b194-35b71944eb4a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.548306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.548947 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.549249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.549541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] PATH_INFO: `/v3/projects/e581c47b05644ab28d06a6bc9a46ffcc/users/a164fcd5cd694cda8da83fc475d4cba1/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.565843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e581c47b05644ab28d06a6bc9a46ffcc, user_id=a164fcd5cd694cda8da83fc475d4cba1, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.569139 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.581594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1332/2630] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:16:51 2022] PUT /identity/v3/projects/e581c47b05644ab28d06a6bc9a46ffcc/users/a164fcd5cd694cda8da83fc475d4cba1/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:16:51.591709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.591994 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.592872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.620737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] MFA Rules not processed for user `a164fcd5cd694cda8da83fc475d4cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:16:51.621979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:51.684702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1299/2631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:16:51.696049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:16:51.697777 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:16:51.719188 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:16:51.755821 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d29ae-16b8-4f52-bf54-d90c0e584c22 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:16:51.759390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:16:51.759988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:16:51.760266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:16:51.760538 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:16:51.768741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:16:51.770299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77543e-7be9-4171-b92c-381255e0afff service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:16:51.779691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1333/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:16:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:01.591608 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:01.610711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:01.654261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d46527-6aec-44a1-a093-b1341a5ed863 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:01.658675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913233aa-6620-4660-b382-628db1570adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:01.659292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913233aa-6620-4660-b382-628db1570adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:01.659572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913233aa-6620-4660-b382-628db1570adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:01.659842 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913233aa-6620-4660-b382-628db1570adc admin admin] PATH_INFO: `/v3/users/a164fcd5cd694cda8da83fc475d4cba1` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:01.660931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913233aa-6620-4660-b382-628db1570adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a164fcd5cd694cda8da83fc475d4cba1)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:01.663418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913233aa-6620-4660-b382-628db1570adc admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:01.708237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a164fcd5cd694cda8da83fc475d4cba1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:01.719645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a164fcd5cd694cda8da83fc475d4cba1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:01.726940 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a164fcd5cd694cda8da83fc475d4cba1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:01.727579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a164fcd5cd694cda8da83fc475d4cba1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:01.728178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a164fcd5cd694cda8da83fc475d4cba1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:01.740958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1300/2633] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:01 2022] DELETE /identity/v3/users/a164fcd5cd694cda8da83fc475d4cba1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:01.745517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:01.746019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:01.746127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:01.764453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:01.765704 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:01.822924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1334/2634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:01.832535 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:01.834463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:01.890843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913233aa-6620-4660-b382-628db1570adc admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:01.894772 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:01.895376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:01.895660 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:01.895939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:01.905446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:01.906863 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb9a6-fc83-4d24-b7b7-72bb547d6218 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:01.916759 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1301/2635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:17:02.180882 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.182444 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:02.195146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1a47-c35d-4cec-96a3-55deb252a2db None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.199826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.200547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.201019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.201392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] PATH_INFO: `/v3/projects/e581c47b05644ab28d06a6bc9a46ffcc` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.202586 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e581c47b05644ab28d06a6bc9a46ffcc)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.204620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.251398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e581c47b05644ab28d06a6bc9a46ffcc', 'request_id': 'req-97c1cb8f-d543-47cc-92dc-648c1215c0ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:02.257462 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e581c47b05644ab28d06a6bc9a46ffcc', 'request_id': 'req-97c1cb8f-d543-47cc-92dc-648c1215c0ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:02.263730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e581c47b05644ab28d06a6bc9a46ffcc', 'request_id': 'req-97c1cb8f-d543-47cc-92dc-648c1215c0ae'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:02.276759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] The token cache is being invalidate because project e581c47b05644ab28d06a6bc9a46ffcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:02.277047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:02.277756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-97c1cb8f-d543-47cc-92dc-648c1215c0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:02.279814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1335/2636] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:02 2022] DELETE /identity/v3/projects/e581c47b05644ab28d06a6bc9a46ffcc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:02.284674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.284962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.285316 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.304138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:02.305351 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:02.337959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:02.364563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1302/2637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:02.373247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.373622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.373966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.394715 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:02.395903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:02.404159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1336/2638] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:02.408343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.417676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5ee3-df34-40be-a0fe-bcd3961d21f2 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.422100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.422680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.422956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.423225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.423857 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:02.424153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.425753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.436715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1303/2639] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:02.440709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.450244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3dff5-775e-4336-b678-183b9c9b0bb4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.454829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.455414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.455691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.455962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.456594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.458550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.487249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1337/2640] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:02.492081 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.501816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7792120-8d13-4697-a40f-39c34104b87a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.557784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.558580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.558898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.559373 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.560403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.562735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.584846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1304/2641] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:02 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:02.588885 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.598976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5eed-7df1-418d-95f5-46ca311b2251 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.603551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.604137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.604417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.604691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.605363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.606950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.617925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1338/2642] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:02.621543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.631782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0b1f9-aead-4785-afa4-625cf3336c84 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.636340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.636920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.637202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.637510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.638145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.639791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019edc1-6b3e-458a-aa4a-23e59d53b344 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.650104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1305/2643] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:02.654051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.663579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e710b3f-3df7-4442-8f78-f3a318fd1439 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.668080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.668711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.668988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.669296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] PATH_INFO: `/v3/projects/301ae8617218468c977da95e02cb75ee/users/db1ece6236d04eddbb87c7e43f3f7e42/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.671414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:02.686789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301ae8617218468c977da95e02cb75ee, user_id=db1ece6236d04eddbb87c7e43f3f7e42, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.689478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.702687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1339/2644] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:02 2022] PUT /identity/v3/projects/301ae8617218468c977da95e02cb75ee/users/db1ece6236d04eddbb87c7e43f3f7e42/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:02.707648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061166-020a-4e41-8a99-f2459b761a7c None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.708166 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061166-020a-4e41-8a99-f2459b761a7c None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.708445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa061166-020a-4e41-8a99-f2459b761a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.726956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fa061166-020a-4e41-8a99-f2459b761a7c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:02.728183 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fa061166-020a-4e41-8a99-f2459b761a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:02.785692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1306/2645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:02.795500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:02.797419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:02.853764 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522a90f-fa32-4dc0-a51f-4b9afc00c0d6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:02.857355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:02.857952 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:02.858229 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:02.858498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:02.867997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:02.869398 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:02.878543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1340/2646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:06.707826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:06.708309 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:06.708573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:06.736445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] MFA Rules not processed for user `db1ece6236d04eddbb87c7e43f3f7e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:06.737710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:06.773000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:06.821989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1307/2647] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:06.826701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:06.836736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c42f5-cb74-4d97-91bd-6ec60715d20a service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:06.841539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:06.842146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:06.842426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:06.842698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:06.843332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:06.845255 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:06.874773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1341/2648] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:06 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:06.879359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:06.891165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bb7a-4f66-4902-9974-3e3ae2bfb9cc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:06.978313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:06.978924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:06.979207 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:06.979484 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:06.980129 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:06.982097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:07.009718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1308/2649] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:06 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:07.013666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:07.024809 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43f48-a7fa-4587-b477-568b221b9da3 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:07.029565 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:07.030181 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:07.030463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:07.030755 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:07.031377 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:07.032984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:07.045981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1342/2650] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:07.050511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:07.061261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cc961-ad19-402a-9e13-4df5b517f1a0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:07.069317 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048a501-6948-4c46-8170-978898944fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:07.070240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a501-6948-4c46-8170-978898944fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:07.070591 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a501-6948-4c46-8170-978898944fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:07.070929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048a501-6948-4c46-8170-978898944fed admin admin] PATH_INFO: `/v3/projects/7c8432beb21948caaff646343339d88e/users/00f6cfeb11b04bdeac9d1211f33dc447/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:07.087637 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048a501-6948-4c46-8170-978898944fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8432beb21948caaff646343339d88e, user_id=00f6cfeb11b04bdeac9d1211f33dc447, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:07.090469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048a501-6948-4c46-8170-978898944fed admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:07.110141 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1309/2651] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:07 2022] PUT /identity/v3/projects/7c8432beb21948caaff646343339d88e/users/00f6cfeb11b04bdeac9d1211f33dc447/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:07.114415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:07.124970 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630a2e7-46a5-495d-bfea-a39e91d44ef9 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:07.184146 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:07.184767 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:07.185041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:07.185348 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:07.185991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:07.187749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797162f-bb80-463c-913e-ee70b77f7c2a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:07.198779 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1343/2652] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:07.202823 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048a501-6948-4c46-8170-978898944fed admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:07.214069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048a501-6948-4c46-8170-978898944fed admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:07.219031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:07.219788 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:07.220137 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:07.220478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] PATH_INFO: `/v3/projects/7c8432beb21948caaff646343339d88e/users/00f6cfeb11b04bdeac9d1211f33dc447/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:07.222548 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8432beb21948caaff646343339d88e, user_id=00f6cfeb11b04bdeac9d1211f33dc447, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:07.225967 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:07.237374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1310/2653] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:07 2022] PUT /identity/v3/projects/7c8432beb21948caaff646343339d88e/users/00f6cfeb11b04bdeac9d1211f33dc447/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:11.546349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899160c-bc71-4d97-8f90-b621f5343288 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:11.546848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899160c-bc71-4d97-8f90-b621f5343288 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:11.546958 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899160c-bc71-4d97-8f90-b621f5343288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:11.578945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-1899160c-bc71-4d97-8f90-b621f5343288 None None] MFA Rules not processed for user `00f6cfeb11b04bdeac9d1211f33dc447`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:11.580141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1899160c-bc71-4d97-8f90-b621f5343288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:11.619918 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:11.663892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1344/2654] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:11.677602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:11.680128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:11.761329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfdc04-6952-4a41-baf6-ff5cdded9ef3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:11.770512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:11.771599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:11.771928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:11.772206 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:11.801610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:11.835204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:11.836789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:11.845996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1311/2655] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:13.016593 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:13.017187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:13.017187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:13.037872 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] MFA Rules not processed for user `db1ece6236d04eddbb87c7e43f3f7e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:13.039166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:13.052032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1345/2656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:13.371648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:13.377375 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:13.403627 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9640f-0354-474f-85a5-38b92fff4120 service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:13.419571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:13.421050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:13.421477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:13.421829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:13.423882 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:13.440757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:13.442924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:13.470222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1312/2657] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:17.624560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:17.703342 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90a857-82af-4ab2-add6-db0fd0f8d3e7 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:17.707754 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:17.708437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:17.708749 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:17.709579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:17.711372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:17.785039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:17.786550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:17.798622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1346/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:21.339761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:21.341175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:21.355685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af0cc3-300c-48c6-be85-201aa9ba5dff service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:21.360168 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:21.360786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:21.361068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:21.361377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] PATH_INFO: `/v3/users/e805d10dcc2e4dc7baf6792c7ca53510` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:21.362493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e805d10dcc2e4dc7baf6792c7ca53510)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:21.364689 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:21.413561 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e805d10dcc2e4dc7baf6792c7ca53510'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.425467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e805d10dcc2e4dc7baf6792c7ca53510'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.433676 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e805d10dcc2e4dc7baf6792c7ca53510'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.434347 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e805d10dcc2e4dc7baf6792c7ca53510'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.435087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-02db9b32-5852-46af-9df7-8ba0a49797b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e805d10dcc2e4dc7baf6792c7ca53510'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.448739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1313/2659] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:21 2022] DELETE /identity/v3/users/e805d10dcc2e4dc7baf6792c7ca53510 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:21.625915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:21.639434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c36aec-aa60-4ba6-82e3-dfd00268105b service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:21.732142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:21.733032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:21.733658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:21.733994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] PATH_INFO: `/v3/projects/791692a741cd49af91cce92a0672b57a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:21.735508 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791692a741cd49af91cce92a0672b57a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:21.737566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:21.763523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:21.815066 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791692a741cd49af91cce92a0672b57a', 'request_id': 'req-3b47a1e4-6509-4cb6-b50c-162a36054f24'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.822487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791692a741cd49af91cce92a0672b57a', 'request_id': 'req-3b47a1e4-6509-4cb6-b50c-162a36054f24'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.829005 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791692a741cd49af91cce92a0672b57a', 'request_id': 'req-3b47a1e4-6509-4cb6-b50c-162a36054f24'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.843420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] The token cache is being invalidate because project 791692a741cd49af91cce92a0672b57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:21.843732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.844341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3b47a1e4-6509-4cb6-b50c-162a36054f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:21.845954 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1347/2660] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:21 2022] DELETE /identity/v3/projects/791692a741cd49af91cce92a0672b57a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:21.851376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:21.851674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:21.851953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:21.872947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:21.874188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:21.934298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1314/2661] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:21.942966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:21.943264 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:21.943608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:21.964010 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:21.965213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:21.973308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1348/2662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:21.978204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:21.987941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de205-9d7b-4b7d-bac7-5c2ae05444ab None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:21.993374 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:21.993982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:21.994263 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:21.994536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:21.995182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:21.995485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:21.997115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.008400 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1315/2663] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:17:22.012862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.022688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33dc1-1282-49d0-abee-69d2a9313b72 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.027507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.028134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.028413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.028686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.029356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.031267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.059473 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1349/2664] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:22 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:22.063852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.074047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc255d7-b638-4ecb-855b-c26b28992750 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.082392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:22.138204 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.138887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.139181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.139453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.140222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.142242 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.165595 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1316/2665] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:22 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:17:22.169594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.183193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82651f-beb3-4532-a16a-4501e6f13434 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.188014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.188637 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.188910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.189187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.189867 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.191491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.201984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1350/2666] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:17:22.206830 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.218131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8785e2-79a1-4381-8ba0-faab9f098faa admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.222881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.223352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.223630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.223905 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.225187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.227106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c2a54-522c-4edb-967b-631d10e24500 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.244685 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1317/2667] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:22.254720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.266341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f2c06-c419-4a1f-99a2-d00fc6afaea7 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.271895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.272560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.272849 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.273125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] PATH_INFO: `/v3/projects/0e782ea111b44143a77f16c4846bb5e3/users/d0245460724a442292f738e7e947c87b/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.288178 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e782ea111b44143a77f16c4846bb5e3, user_id=d0245460724a442292f738e7e947c87b, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.291124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.305746 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1351/2668] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:22 2022] PUT /identity/v3/projects/0e782ea111b44143a77f16c4846bb5e3/users/d0245460724a442292f738e7e947c87b/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:22.310900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.311123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.311398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.333429 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:22.334698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:22.398588 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1318/2669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:22.408007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:22.409959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:22.472172 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73022f5-384b-4a3c-ac34-1a56afad1838 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:22.475945 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:22.476550 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:22.476829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:22.477100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:22.486526 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:22.488042 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79df478-6a07-4ab7-ae35-58feeb1aabd5 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:22.498541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1352/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:27.314270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:27.315417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:27.315847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:27.315949 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.316065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:27.328467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec2d97-c0ac-4e82-a825-dd8deb9771ba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:27.332140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:27.332744 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:27.333050 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:27.333364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:27.335668 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.345314 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:27.345856 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] MFA Rules not processed for user `d0245460724a442292f738e7e947c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:27.346738 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:27.347026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.355789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1319/2671] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:27.356505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:27.357810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.384491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:27.419502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1353/2672] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:17:27.424816 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe203de9-1f45-452f-8648-422e0fad3bd9 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:27.428522 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:27.429132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:27.429452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:27.429729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:27.431984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.434552 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:27.435895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:27.476580 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:27.513723 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:27.515159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1563647-aa03-4b86-af28-d76f84c4ee4b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:27.525202 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1320/2673] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:27.534932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616337be-6dbc-42a0-8cc7-6ee6b5d8eb33 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:27.544137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:27.544825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:27.545263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:27.545631 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:27.554298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:27.555890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e50ce-bb7d-4fc4-8fd6-79ac3990a42f service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:27.565180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1354/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:17:28.030321 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460d59-03b0-492b-a4f2-c0b53fa784f4 None None] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:28.030600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460d59-03b0-492b-a4f2-c0b53fa784f4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:28.031043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460d59-03b0-492b-a4f2-c0b53fa784f4 None None] PATH_INFO: `/` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:28.032756 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1321/2675] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 14:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 14:17:28.038332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:28.038962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:28.039470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:28.078702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] MFA Rules not processed for user `b1370e4280744ad6b76881a9e0fafbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:28.080984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:28.187698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1355/2676] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:28.196681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90460d59-03b0-492b-a4f2-c0b53fa784f4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:28.211972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90460d59-03b0-492b-a4f2-c0b53fa784f4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:28.217946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:28.218570 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:28.218870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:28.219318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:28.221181 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:28.237643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:28.239543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d94b4-0467-4576-b3e1-9992bd55acc9 service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:28.250804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1322/2677] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:29.120569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:29.131491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43ed1-0901-48b4-a819-8a2b6927de98 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:29.139919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:29.142619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:29.143095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:29.143584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:29.146920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:29.150486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:29.150957 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:29.151163 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:29.168527 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:29.170420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:29.171280 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] MFA Rules not processed for user `d0245460724a442292f738e7e947c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:29.172491 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:29.186468 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1323/2678] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:29.203897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1356/2679] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:29.584969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:29.600761 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b20a3-464b-4cb8-8799-6379f93c0d82 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:29.605431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:29.606045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:29.606325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:29.606600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:29.609022 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:29.623757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:29.626009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:29.636906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1324/2680] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:33.412283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:33.429910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e9fd-db71-4feb-abb9-e37fa7444a20 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:33.448678 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:33.449339 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:33.449626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:33.449905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:33.451884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:33.466676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:33.468294 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:33.481054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1357/2681] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:35.052740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:35.054654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:35.069571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5f056-15bc-459b-ac1c-ec7e01de17e8 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:35.074573 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:35.075165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.075447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.075719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.077485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:35.090019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:35.091860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:35.105176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1325/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:35.106239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:35.107709 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:35.123249 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f526-05d4-4e54-a327-274694113ff7 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:35.127893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:35.128521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.128826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.129102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] PATH_INFO: `/v3/users/5fca6a15a17c423393582da43abec450` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.130782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fca6a15a17c423393582da43abec450)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:35.132730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:35.161700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:35.180658 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fca6a15a17c423393582da43abec450'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.192364 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fca6a15a17c423393582da43abec450'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.193591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fca6a15a17c423393582da43abec450'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.200785 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fca6a15a17c423393582da43abec450'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.201431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2fcdc531-4e1a-4a52-8740-ad1d44a19adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fca6a15a17c423393582da43abec450'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.214225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1358/2683] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:35 2022] DELETE /identity/v3/users/5fca6a15a17c423393582da43abec450 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:35.531605 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:35.543042 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb2ab2-539d-4ddc-8dcf-fe852e0e614f service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:35.670123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:35.670872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.671223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.671574 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] PATH_INFO: `/v3/projects/b3297ab419b04e7faf1738e64ab28c3c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.672860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3297ab419b04e7faf1738e64ab28c3c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:35.675196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:35.748953 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3297ab419b04e7faf1738e64ab28c3c', 'request_id': 'req-305c167a-6068-4d8b-bb8b-118033bb3ac2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.758923 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3297ab419b04e7faf1738e64ab28c3c', 'request_id': 'req-305c167a-6068-4d8b-bb8b-118033bb3ac2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.775836 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3297ab419b04e7faf1738e64ab28c3c', 'request_id': 'req-305c167a-6068-4d8b-bb8b-118033bb3ac2'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.796497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] The token cache is being invalidate because project b3297ab419b04e7faf1738e64ab28c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:35.796809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.797530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-305c167a-6068-4d8b-bb8b-118033bb3ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:35.803974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1326/2684] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:35 2022] DELETE /identity/v3/projects/b3297ab419b04e7faf1738e64ab28c3c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:35.806165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.806554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.806927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.829449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:35.830909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:35.893630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1359/2685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:35.901520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.902229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.902229 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.922958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:35.924156 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:35.933135 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1327/2686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:35.937507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:35.947296 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89753d6-230c-4d71-ae0e-f73ce78de4f9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:35.952513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:35.953199 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.953570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.953912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.954655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:35.955023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:35.957126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:35.969136 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1360/2687] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:35.973430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:35.982948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b76be-cd9f-419a-9193-b21b0569b9a4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:35.987516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:35.988356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:35.988634 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:35.988902 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:35.990203 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:35.992083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:35.997486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:36.019730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1328/2688] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:35 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:17:36.023789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.033520 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a803eab-5c62-4c31-b754-277a41954878 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.090574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.091182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.091458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.091728 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.092396 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.094353 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.115795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1361/2689] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:36 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:36.119859 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.129775 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd2403-d573-4cff-99f5-b547b8fe4e0c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.134268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.134846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.135123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.135394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.136018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.137624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.147126 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1329/2690] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:36.150904 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.160617 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24302-e634-4414-b996-c9cabb05cf5a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.166412 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.166846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.167131 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.167407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.168056 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.169860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d866d67-4647-4532-bda5-b8867d4dfb77 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.183434 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1362/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:36.187551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.197452 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d56e-8b10-47e1-ad00-4bd89e8c5c80 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.202127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.202783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.203062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.203335 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] PATH_INFO: `/v3/projects/c611ac6bd0054047a305212a28680f48/users/24b009869d4841df891c39718549fb77/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.217765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c611ac6bd0054047a305212a28680f48, user_id=24b009869d4841df891c39718549fb77, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.220407 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.233267 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1330/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:36 2022] PUT /identity/v3/projects/c611ac6bd0054047a305212a28680f48/users/24b009869d4841df891c39718549fb77/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:36.244130 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.244422 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.244701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.263861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:36.274302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] MFA Rules not processed for user `24b009869d4841df891c39718549fb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:36.275768 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:36.338314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1363/2693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:36.342802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.403787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39fe8f-f6ea-479f-ad16-37fcb0a75651 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.408401 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.408997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.409302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.409578 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.410196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.412649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.438190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1331/2694] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:36 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:36.442432 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.453213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76a4f-1724-4d57-9e4e-3112e9681ee4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.509513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.510134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.510417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.510691 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.511314 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.513250 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.540071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1364/2695] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:36 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:36.541406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.551716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698407d1-a3a7-46af-ad9b-c1dcb0709b74 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.556325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.556980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.557382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.557700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.558399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.560038 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.574430 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1332/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:36.575686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.586154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49672b6b-3598-4e85-9059-5292d82fcdb2 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.590908 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.591559 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.591839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.592113 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] PATH_INFO: `/v3/projects/576c5ae8583c41e290b0b967b2c5fd63/users/642a0d7aba044712a0fa6a3ed9ca7f0c/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.608495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=576c5ae8583c41e290b0b967b2c5fd63, user_id=642a0d7aba044712a0fa6a3ed9ca7f0c, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.611418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.627019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1365/2697] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:36 2022] PUT /identity/v3/projects/576c5ae8583c41e290b0b967b2c5fd63/users/642a0d7aba044712a0fa6a3ed9ca7f0c/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:36.632187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.642707 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7d9ad-ecd0-4761-8dd8-0c08ad479ec1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.709541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.710161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.710444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.710717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.711369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.713002 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd7e29-f971-4ad2-ba2d-0d45368b160b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.724494 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1333/2698] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:36.728553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.739896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c38c3-3ae5-427e-8f66-26e6136c35fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.744687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.745401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.745687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.746122 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] PATH_INFO: `/v3/projects/576c5ae8583c41e290b0b967b2c5fd63/users/642a0d7aba044712a0fa6a3ed9ca7f0c/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.748667 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=576c5ae8583c41e290b0b967b2c5fd63, user_id=642a0d7aba044712a0fa6a3ed9ca7f0c, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.751016 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:36.765326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1366/2699] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:36 2022] PUT /identity/v3/projects/576c5ae8583c41e290b0b967b2c5fd63/users/642a0d7aba044712a0fa6a3ed9ca7f0c/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:36.777802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.777998 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.778412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.811425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] MFA Rules not processed for user `642a0d7aba044712a0fa6a3ed9ca7f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:36.812649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:36.823795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:36.885782 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1334/2700] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:36.898291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:36.900090 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:36.969616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50870cc8-8236-40bc-9ffc-c56f60d0b71c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:36.973665 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:36.974566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:36.974919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:36.975288 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:36.981600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:36.986685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:36.990279 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:37.001791 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1367/2701] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:37.101131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:37.115703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e4795-bdec-42d8-a9a8-5cc326b0ed6a None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:37.119446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:37.120046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:37.120610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:37.120610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:37.178249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:37.179693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:37.188445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1335/2702] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:38.715529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:38.717210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:38.806095 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d35d-93f8-440e-b954-ee510690f4f0 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:38.811830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:38.812707 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:38.812855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:38.813046 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:38.814951 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:38.828720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:38.830404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:38.843478 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1368/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:42.011358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:42.012753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:42.068186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f403-c9a8-45ab-b93c-1e28b862870d service cinder] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:42.071891 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:42.072485 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:42.072763 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:42.073030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:42.074757 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:42.137943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:42.140518 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:42.142394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941105ac-8a5e-4d9d-9285-90440edfff43 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:42.153663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1336/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:44.099194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:44.181528 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2df57-7a35-4c88-8548-29dc1129d996 service nova] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:44.186455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:44.187069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:44.187933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:44.188223 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] PATH_INFO: `/v3/users/24b009869d4841df891c39718549fb77` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:44.190220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b009869d4841df891c39718549fb77)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:44.194313 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:44.286622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b009869d4841df891c39718549fb77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:44.306336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b009869d4841df891c39718549fb77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:44.309260 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b009869d4841df891c39718549fb77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:44.330171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b009869d4841df891c39718549fb77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:44.330831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b009869d4841df891c39718549fb77'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:44.345147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:44.368517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1369/2705] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:44 2022] DELETE /identity/v3/users/24b009869d4841df891c39718549fb77 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:44.370262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:44.370755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:44.370948 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:44.393764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:44.395420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:44.492392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1337/2706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:44.537433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:44.539083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:44.641006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9990b7-cac6-408a-ab09-0474e8d25660 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:44.646628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:44.647489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:44.648330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:44.648330 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:44.662487 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:44.664831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:44.676973 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1370/2707] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:17:45.068380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:45.070105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:45.085423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b1df-3325-4dfc-94fa-c40885433bea None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:45.091655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:45.092246 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.092529 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.092835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] PATH_INFO: `/v3/projects/c611ac6bd0054047a305212a28680f48` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.094018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c611ac6bd0054047a305212a28680f48)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:45.095936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:45.165111 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c611ac6bd0054047a305212a28680f48', 'request_id': 'req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.174748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c611ac6bd0054047a305212a28680f48', 'request_id': 'req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.186576 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c611ac6bd0054047a305212a28680f48', 'request_id': 'req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.200755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] The token cache is being invalidate because project c611ac6bd0054047a305212a28680f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:45.201045 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.201741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.203482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1338/2708] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:45 2022] DELETE /identity/v3/projects/c611ac6bd0054047a305212a28680f48 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:45.207569 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:45.217938 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae16c23-421f-44db-8112-f404804fafe1 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:45.281766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:45.282400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.282730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.283077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] PATH_INFO: `/v3/users/642a0d7aba044712a0fa6a3ed9ca7f0c` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.284304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=642a0d7aba044712a0fa6a3ed9ca7f0c)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:45.286985 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:45.347297 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642a0d7aba044712a0fa6a3ed9ca7f0c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.360356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642a0d7aba044712a0fa6a3ed9ca7f0c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.361054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642a0d7aba044712a0fa6a3ed9ca7f0c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.368623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642a0d7aba044712a0fa6a3ed9ca7f0c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.369268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-8acbc6c9-2280-4a28-ac6a-4228efd94f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642a0d7aba044712a0fa6a3ed9ca7f0c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.381354 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1371/2709] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:45 2022] DELETE /identity/v3/users/642a0d7aba044712a0fa6a3ed9ca7f0c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:45.648978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:45.650471 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:45.663075 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e19fc-7b5e-43a2-a92c-dc673c6e2b90 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:45.732997 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:45.733653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.733933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.734250 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] PATH_INFO: `/v3/projects/576c5ae8583c41e290b0b967b2c5fd63` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.735364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576c5ae8583c41e290b0b967b2c5fd63)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:45.737281 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:45.760736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:45.790780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576c5ae8583c41e290b0b967b2c5fd63', 'request_id': 'req-3e4ad0d3-06e4-4f43-8df1-b496610b6160'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.798734 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576c5ae8583c41e290b0b967b2c5fd63', 'request_id': 'req-3e4ad0d3-06e4-4f43-8df1-b496610b6160'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.804460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576c5ae8583c41e290b0b967b2c5fd63', 'request_id': 'req-3e4ad0d3-06e4-4f43-8df1-b496610b6160'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.818353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] The token cache is being invalidate because project 576c5ae8583c41e290b0b967b2c5fd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:45.818649 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.821579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-3e4ad0d3-06e4-4f43-8df1-b496610b6160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:45.822976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1339/2710] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:45 2022] DELETE /identity/v3/projects/576c5ae8583c41e290b0b967b2c5fd63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:45.827936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.828216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.828488 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.848287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:45.849503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:45.861752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:45.908877 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1372/2711] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:45.916477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.916797 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.917077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.936531 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:45.937774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:45.946237 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1340/2712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:45.950418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:45.960663 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511747f-f92a-4300-aa51-0bbfcd8c65a4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:45.965234 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:45.965830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:45.966240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:45.966522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:45.967162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:45.967463 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:45.969074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:45.980672 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1373/2713] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:45.984686 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:45.994545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690b4c1-ddcd-4a90-9a7d-3dd1b3dfe372 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:45.999153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:45.999737 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.000018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.000293 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.000931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.002864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.029439 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1341/2714] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:45 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:46.033491 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.043517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d4ac-e705-47be-8ebe-cff960996bda admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.103765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.104300 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.104614 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.104893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.105575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.107513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.128270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1374/2715] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:46 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:46.132982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.143197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2daa2-69da-4aa6-87ec-3e4405c688be admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.147846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.148440 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.148724 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.148999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.149681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.151270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.161666 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1342/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:46.165687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.175608 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2dba0-96a6-4cae-bcf5-122f4eca3f84 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.180687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.181345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.181629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.181925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.182574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.184161 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c63028-c5d4-4edb-8d15-8d8c096baeaf admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.195144 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1375/2717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:46.199239 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.209807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e77df-8e2b-4557-9f61-c95af244bc18 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.215009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.215867 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.216145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.216446 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] PATH_INFO: `/v3/projects/db680cc14878406cb31d3bea9bd887b1/users/00e72a1dfdde422c824c6df666bc8cd6/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.232557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db680cc14878406cb31d3bea9bd887b1, user_id=00e72a1dfdde422c824c6df666bc8cd6, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.235231 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.248327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1343/2718] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:46 2022] PUT /identity/v3/projects/db680cc14878406cb31d3bea9bd887b1/users/00e72a1dfdde422c824c6df666bc8cd6/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:46.259875 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.260414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.260414 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.288485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] MFA Rules not processed for user `00e72a1dfdde422c824c6df666bc8cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:46.289730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:46.356102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1376/2719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:46.360713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.424510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc9d9-0416-4020-bd3e-c7a610ffef9b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.429164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.429818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.430104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.430382 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.431029 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.432933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.462670 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1344/2720] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:46.467309 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.479453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21270-da31-484f-81fb-237aeb22b956 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.491829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:46.541126 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.541770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.542052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.542443 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.543104 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.545325 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.568481 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1377/2721] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:46 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:46.572361 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.583504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77cc4-94b6-420c-ac8c-c75fac040e6b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.589049 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.589709 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.589989 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.590262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.590901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.592510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.604298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1345/2722] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:46.608641 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.619474 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99226-52b2-4eff-b6fb-4eebd2f1d2f0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.624268 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.624925 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.625212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.625514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] PATH_INFO: `/v3/projects/52a0aee773e24b67be35564a4f17eda0/users/5c0215de828145089a5fc4341760983f/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.642753 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a0aee773e24b67be35564a4f17eda0, user_id=5c0215de828145089a5fc4341760983f, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.646023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.662536 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1378/2723] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:46 2022] PUT /identity/v3/projects/52a0aee773e24b67be35564a4f17eda0/users/5c0215de828145089a5fc4341760983f/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:46.663769 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.673996 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfcfb9-d4fd-4236-9bbe-a133ba1bb39a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.691718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:46.738539 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.739933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.740210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.740480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.741260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.742851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a16d21-be97-4689-b0d0-5a259567aee1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.754458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1346/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:17:46.759263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.770057 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac76a4-58fc-45c7-836f-8076bf483f95 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.775029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.775693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.775962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.776352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] PATH_INFO: `/v3/projects/52a0aee773e24b67be35564a4f17eda0/users/5c0215de828145089a5fc4341760983f/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.778417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a0aee773e24b67be35564a4f17eda0, user_id=5c0215de828145089a5fc4341760983f, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:46.781324 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:46.792490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1379/2725] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:46 2022] PUT /identity/v3/projects/52a0aee773e24b67be35564a4f17eda0/users/5c0215de828145089a5fc4341760983f/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:17:46.806556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.806936 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.807377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:46.837469 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] MFA Rules not processed for user `5c0215de828145089a5fc4341760983f`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:46.838702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:46.910528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1347/2726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:46.923721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:46.925453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:46.984981 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77003b7-cea6-4f52-925f-0ad0aac8a089 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:46.989724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:46.990397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:46.990683 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:46.990957 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:47.000129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:47.001604 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd53ea-2efd-4aef-aba0-4286235f5efb service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:47.011896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1380/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:47.424353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:47.485106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab535b5-da96-4a47-bcba-1f64f94a0372 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:47.490560 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:47.491182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:47.491465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:47.491746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] PATH_INFO: `/v3/users/00e72a1dfdde422c824c6df666bc8cd6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:47.492875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e72a1dfdde422c824c6df666bc8cd6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:47.494854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:47.538397 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:47.541569 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e72a1dfdde422c824c6df666bc8cd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:47.559630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e72a1dfdde422c824c6df666bc8cd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:47.566926 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e72a1dfdde422c824c6df666bc8cd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:47.567592 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e72a1dfdde422c824c6df666bc8cd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:47.568209 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e72a1dfdde422c824c6df666bc8cd6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:47.580612 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1348/2728] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:47 2022] DELETE /identity/v3/users/00e72a1dfdde422c824c6df666bc8cd6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:17:47.585696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:47.586162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:47.586281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:47.605093 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:47.606293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:47.663861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1381/2729] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:47.673448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:47.674860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:47.730978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28e10-b5bc-4292-85f7-5075584296a6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:47.734647 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:47.735238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:47.735520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:47.735793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:47.745031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:47.746503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:47.755747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1349/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:48.019417 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.021451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:48.034116 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664510b-2f0d-451d-9eb1-d1ff1469151f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.038827 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.039449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.039731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.040006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] PATH_INFO: `/v3/projects/db680cc14878406cb31d3bea9bd887b1` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.041114 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db680cc14878406cb31d3bea9bd887b1)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.043048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:48.049826 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:48.091169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db680cc14878406cb31d3bea9bd887b1', 'request_id': 'req-6323692a-f186-499b-8a78-5e11b92b3c7d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.096547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db680cc14878406cb31d3bea9bd887b1', 'request_id': 'req-6323692a-f186-499b-8a78-5e11b92b3c7d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.102654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db680cc14878406cb31d3bea9bd887b1', 'request_id': 'req-6323692a-f186-499b-8a78-5e11b92b3c7d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.114881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] The token cache is being invalidate because project db680cc14878406cb31d3bea9bd887b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:48.115153 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.115780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.117293 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1382/2731] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:48 2022] DELETE /identity/v3/projects/db680cc14878406cb31d3bea9bd887b1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:17:48.121200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.131115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dcb0b-615f-4294-95f7-5bcca0b7d0b2 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.184631 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.185252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.185540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.185807 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] PATH_INFO: `/v3/users/5c0215de828145089a5fc4341760983f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.186897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0215de828145089a5fc4341760983f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.188793 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:48.240609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0215de828145089a5fc4341760983f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.252771 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0215de828145089a5fc4341760983f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.255178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:48.262069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0215de828145089a5fc4341760983f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.263115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0215de828145089a5fc4341760983f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.263719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-1fe35e35-2026-49fb-8233-806d44b15f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0215de828145089a5fc4341760983f'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.276100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1350/2732] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:48 2022] DELETE /identity/v3/users/5c0215de828145089a5fc4341760983f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:48.545597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.547039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:48.560495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323692a-f186-499b-8a78-5e11b92b3c7d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.619790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.620446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.620690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.620963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] PATH_INFO: `/v3/projects/52a0aee773e24b67be35564a4f17eda0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.622102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a0aee773e24b67be35564a4f17eda0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.624014 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:48.668789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a0aee773e24b67be35564a4f17eda0', 'request_id': 'req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.674166 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a0aee773e24b67be35564a4f17eda0', 'request_id': 'req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.680714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a0aee773e24b67be35564a4f17eda0', 'request_id': 'req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.692869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] The token cache is being invalidate because project 52a0aee773e24b67be35564a4f17eda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:48.693157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.693814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-11b99b6a-4e4b-4d51-a0ee-2e7191e71945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:48.695283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1383/2733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:48 2022] DELETE /identity/v3/projects/52a0aee773e24b67be35564a4f17eda0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:48.700164 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.700619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.700714 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.719950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:48.721153 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:48.781694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1351/2734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:48.789801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.790089 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.790368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.810556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:48.811760 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:48.819633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1384/2735] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:48.823735 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.833287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57473a8f-8b8e-4d7f-8f52-a2007117e2e9 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.837946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.838541 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.838822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.839097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] PATH_INFO: `/v3/domains` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.839743 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81612) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:48.840048 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.841681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:48.853493 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1352/2736] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:48.857710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.867751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676f08a-1feb-4e5f-bf1a-3d094dfc0bc5 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.872993 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.873598 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.873887 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.874165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.874815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.876758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:48.892318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:48.904813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1385/2737] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:48 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:17:48.909065 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:48.919883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ae6e-e267-4414-a36d-ceca9625927c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:48.974927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:48.975520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:48.975847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:48.976155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:48.976820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:48.978810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.001041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1353/2738] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:48 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:49.005254 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.015820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c2d62-4ee1-486e-acfc-c1f15c135e28 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.021208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.021897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.022175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.022445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.023081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.024662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.034736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1386/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:49.039073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.048849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e6425-28b7-470b-b2f5-c975ceccbaf3 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.053512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.054098 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.054378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.054652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.055290 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.056895 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8747-e762-44ea-88e8-f7302d1bf8b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.068403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1354/2740] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:49.072572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.082490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7a77b-52f7-458b-b97c-81417720a891 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.087792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.088447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.088729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.089013 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] PATH_INFO: `/v3/projects/d0a74c8f186e40a686b36391806155a3/users/01f61c8798ce404fb03d1657b8141130/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.103883 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a74c8f186e40a686b36391806155a3, user_id=01f61c8798ce404fb03d1657b8141130, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.106583 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.120082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1387/2741] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:49 2022] PUT /identity/v3/projects/d0a74c8f186e40a686b36391806155a3/users/01f61c8798ce404fb03d1657b8141130/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:49.132244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.132536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.132809 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.160205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] MFA Rules not processed for user `01f61c8798ce404fb03d1657b8141130`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:49.161463 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:49.199128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:49.226475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1355/2742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:17:49.230946 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.292808 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115d77-8ccc-47af-b221-6c16b4014bc5 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.297445 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.298048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.298332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.298609 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.299240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.301141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.327406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1388/2743] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:49 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:49.331513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.342058 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37fa98-023d-4105-adce-88d9a32726f6 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.397403 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.398000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.398308 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.398582 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] PATH_INFO: `/v3/users` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.399197 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.401095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.421886 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1356/2744] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:49 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:49.425975 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.436695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ec0f-d402-4805-9f69-a0964e745936 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.441435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.442032 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.442315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.442597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.443240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.444847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.455246 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1389/2745] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:49.459088 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.468674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff11ce-b87a-4de1-86d4-4020ffbddc81 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.473753 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.474384 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.474664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.474938 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] PATH_INFO: `/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b/users/1b144739ef1749e68e87778b82bd3bbe/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.490087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b36942c5d8a495184a9f7c1bed7fe9b, user_id=1b144739ef1749e68e87778b82bd3bbe, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.494178 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.508454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1357/2746] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:49 2022] PUT /identity/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b/users/1b144739ef1749e68e87778b82bd3bbe/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:49.512351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.522543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c89c-bda1-457b-8c72-7c3bbf74efb6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.579690 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.580226 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.580790 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.581071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.581736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.583366 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19884-80ed-426b-9854-ea685459e193 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.592869 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1390/2747] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:49.597062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.607716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfec97b-6779-4ed8-8164-cc7532016df2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.612325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.613212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.613520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.613791 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] PATH_INFO: `/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b/users/1b144739ef1749e68e87778b82bd3bbe/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.616279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b36942c5d8a495184a9f7c1bed7fe9b, user_id=1b144739ef1749e68e87778b82bd3bbe, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.618939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.628829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1358/2748] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:49 2022] PUT /identity/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b/users/1b144739ef1749e68e87778b82bd3bbe/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:49.638835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.639276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.639507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.667220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] MFA Rules not processed for user `1b144739ef1749e68e87778b82bd3bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:49.668431 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:49.687574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:49.738512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1391/2749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:49.750139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:49.751838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:49.809645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62661ca-cc09-483a-aedc-eafe26d3cd8a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:49.813276 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:49.813874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:49.814151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:49.814422 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:49.823755 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:49.825176 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dc4f8-11b2-41d7-8b76-0e4154184f24 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:49.834505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1359/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:51.168596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:51.229158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a57e8-f87c-4564-9f9a-fca405d8b216 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:51.233592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:51.234221 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:51.234485 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:51.234756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] PATH_INFO: `/v3/users/01f61c8798ce404fb03d1657b8141130` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:51.235852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f61c8798ce404fb03d1657b8141130)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:51.238082 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:51.283582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f61c8798ce404fb03d1657b8141130'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.295185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f61c8798ce404fb03d1657b8141130'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.295842 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f61c8798ce404fb03d1657b8141130'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.303290 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f61c8798ce404fb03d1657b8141130'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.304401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f61c8798ce404fb03d1657b8141130'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.316498 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1392/2751] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:51 2022] DELETE /identity/v3/users/01f61c8798ce404fb03d1657b8141130 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:51.321792 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:51.322292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:51.322394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:51.340680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:51.341906 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:51.370519 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:51.401777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1360/2752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:51.411285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:51.412695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:51.452523 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:51.471127 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416860b-e468-4cc3-b40d-b3e8969e94fb admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:51.474742 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:51.475340 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:51.475621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:51.475914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:51.484610 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:51.486065 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:51.496043 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1393/2753] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:51.764356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:51.765802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:51.777986 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d9c51-02cd-48c9-a948-b810c5331811 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:51.783017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:51.783651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:51.783930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:51.784266 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] PATH_INFO: `/v3/projects/d0a74c8f186e40a686b36391806155a3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:51.786302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a74c8f186e40a686b36391806155a3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:51.787995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:51.835508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a74c8f186e40a686b36391806155a3', 'request_id': 'req-094deca3-c045-4599-b5d9-52a6b28877e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.843826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a74c8f186e40a686b36391806155a3', 'request_id': 'req-094deca3-c045-4599-b5d9-52a6b28877e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.850376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a74c8f186e40a686b36391806155a3', 'request_id': 'req-094deca3-c045-4599-b5d9-52a6b28877e1'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.861363 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] The token cache is being invalidate because project d0a74c8f186e40a686b36391806155a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:51.861653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.862294 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.864697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1361/2754] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:51 2022] DELETE /identity/v3/projects/d0a74c8f186e40a686b36391806155a3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:51.868589 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:51.878185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d662fc6-fd60-44fa-ad78-424a31d4e855 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:51.935436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:51.935989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:51.936270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:51.936543 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] PATH_INFO: `/v3/users/1b144739ef1749e68e87778b82bd3bbe` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:51.937698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b144739ef1749e68e87778b82bd3bbe)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:51.939620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:51.983518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b144739ef1749e68e87778b82bd3bbe'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.995636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b144739ef1749e68e87778b82bd3bbe'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:51.996282 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b144739ef1749e68e87778b82bd3bbe'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.003551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b144739ef1749e68e87778b82bd3bbe'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.004171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-3cb54770-989f-4e9a-8af2-1d22152cd63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b144739ef1749e68e87778b82bd3bbe'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.016036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1394/2755] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:51 2022] DELETE /identity/v3/users/1b144739ef1749e68e87778b82bd3bbe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:52.287924 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.289387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:52.304919 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094deca3-c045-4599-b5d9-52a6b28877e1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.361152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.361810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.362082 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.362359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] PATH_INFO: `/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.364221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b36942c5d8a495184a9f7c1bed7fe9b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.366173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.411870 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b36942c5d8a495184a9f7c1bed7fe9b', 'request_id': 'req-0f00da8b-632b-4f34-916d-d2ba1e86d57c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.418885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b36942c5d8a495184a9f7c1bed7fe9b', 'request_id': 'req-0f00da8b-632b-4f34-916d-d2ba1e86d57c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.420897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:52.425619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b36942c5d8a495184a9f7c1bed7fe9b', 'request_id': 'req-0f00da8b-632b-4f34-916d-d2ba1e86d57c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.438114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] The token cache is being invalidate because project 3b36942c5d8a495184a9f7c1bed7fe9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:52.438420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.439041 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0f00da8b-632b-4f34-916d-d2ba1e86d57c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:52.440517 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1362/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:52 2022] DELETE /identity/v3/projects/3b36942c5d8a495184a9f7c1bed7fe9b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:52.445560 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e089b-5991-43db-994a-ad7789c45793 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.446047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e089b-5991-43db-994a-ad7789c45793 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.446173 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e089b-5991-43db-994a-ad7789c45793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.465163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-677e089b-5991-43db-994a-ad7789c45793 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:52.466301 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-677e089b-5991-43db-994a-ad7789c45793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:52.516187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:52.529392 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1395/2757] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:17:52.536806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.537091 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.537406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.558028 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:52.559228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:52.567192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1363/2758] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:52.572259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e089b-5991-43db-994a-ad7789c45793 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.581852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e089b-5991-43db-994a-ad7789c45793 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.586699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.587317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.587603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.587972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.588681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:52.588991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.590623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.603031 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1396/2759] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:52.607244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.617121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03109832-fbb9-482c-ba53-6585546d0e4d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.621713 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.622287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.622558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.622825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.623478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.625386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.650593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1364/2760] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:52 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:17:52.654562 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.664935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da09a5c-e23f-4985-8c45-96cf7de85703 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.719692 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.719926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.720175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.720471 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.721076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.723525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.744464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1397/2761] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:52 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:52.748488 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.758618 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6476a-a393-404d-ad16-3ee5488e6751 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.763402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.764024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.764303 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.764577 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.765271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.766855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.777864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1365/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:52.781803 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.792286 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6d2b-a3d1-4ed1-9160-0543cdee3ace admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.796868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.797495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.797788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.798069 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.798706 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.800299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d5f6f-2781-4e6a-8f06-6ea2bf9f2848 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.810117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1398/2763] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:52.814249 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.824201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4c26-25cd-4eb7-b91f-08c4102e4fb7 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:52.828749 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:52.829417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.829874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.830031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] PATH_INFO: `/v3/projects/cd4c7d4d2d2045028a6599bcfb5ae849/users/ddcbf9a555c542ab81622995ec21d52f/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.844828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4c7d4d2d2045028a6599bcfb5ae849, user_id=ddcbf9a555c542ab81622995ec21d52f, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:52.847536 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:52.861211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1366/2764] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:52 2022] PUT /identity/v3/projects/cd4c7d4d2d2045028a6599bcfb5ae849/users/ddcbf9a555c542ab81622995ec21d52f/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:52.872619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:52.872909 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:52.873211 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:52.901852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] MFA Rules not processed for user `ddcbf9a555c542ab81622995ec21d52f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:52.903048 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:52.966693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1399/2765] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:52.978353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:52.980018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.036304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05f75c-7889-4b4d-8e65-1ecaf1d32a30 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.039917 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.040513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.040795 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.041067 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.049108 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.050550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dcb2b-37e6-4053-9c9a-c72b3da2d4bb service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.059543 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1367/2766] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:53.078074 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.128517 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:53.140860 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffaf07-29c0-4ea3-be3e-085dfbdb51b3 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.146232 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.146858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.147141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.147416 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] PATH_INFO: `/v3/users/ddcbf9a555c542ab81622995ec21d52f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.148594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcbf9a555c542ab81622995ec21d52f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.150554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.195035 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcbf9a555c542ab81622995ec21d52f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.206673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcbf9a555c542ab81622995ec21d52f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.207355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcbf9a555c542ab81622995ec21d52f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.214942 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcbf9a555c542ab81622995ec21d52f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.215662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcbf9a555c542ab81622995ec21d52f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.227729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1400/2767] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:53 2022] DELETE /identity/v3/users/ddcbf9a555c542ab81622995ec21d52f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:53.232804 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.233094 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.233417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.252552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:53.253796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.313186 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1368/2768] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:17:53.323621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.325001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.382167 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a9d1-2e1e-4c85-ab09-baa71ca910d4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.385831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.386453 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.386735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.387011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.396437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.397929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadff722-5ca2-4a9c-9c23-1a4e7dab2ee9 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.407194 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1401/2769] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:53.670143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.672026 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.688575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7c86d-229a-4689-ba4c-c183449b8715 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.693789 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.694445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.694663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.694939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] PATH_INFO: `/v3/projects/cd4c7d4d2d2045028a6599bcfb5ae849` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.696128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4c7d4d2d2045028a6599bcfb5ae849)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.698194 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.720389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:53.746712 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4c7d4d2d2045028a6599bcfb5ae849', 'request_id': 'req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.755286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4c7d4d2d2045028a6599bcfb5ae849', 'request_id': 'req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.761212 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4c7d4d2d2045028a6599bcfb5ae849', 'request_id': 'req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.772563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] The token cache is being invalidate because project cd4c7d4d2d2045028a6599bcfb5ae849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:17:53.772916 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.773695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0945e694-32e6-408f-bbf8-19b5c1c7ac8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:53.775305 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1369/2770] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:17:53 2022] DELETE /identity/v3/projects/cd4c7d4d2d2045028a6599bcfb5ae849 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:53.780107 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.780561 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.780675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.799959 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:53.801682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.858129 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1402/2771] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:53.866549 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.866839 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.867138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.887097 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:53.888298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:53.896079 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1370/2772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:53.900102 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.909657 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf922ad0-fb14-4123-8b23-8d5cdd0e6cd8 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.914686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.915281 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.915558 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.915832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.916472 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:17:53.916775 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.918577 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.931024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1403/2773] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:17:53.935602 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.948106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1daf-3da7-4925-b642-6445ee1689f1 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:53.952736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:53.953457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:53.953740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:53.954012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:53.954651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:53.956563 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:53.983381 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1371/2774] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:17:53 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:17:53.987650 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:53.993705 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:54.000283 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb678-1f24-43bf-a2b4-39e69f715d44 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:54.054807 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:54.055400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.055685 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.055955 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.056580 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:54.058521 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:54.078828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1404/2775] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:17:53 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:17:54.083120 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:54.093271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7ed5-cc77-4f04-9830-e365387edb7a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:54.097846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:54.098932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.099211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.099481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.100110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:54.101746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:54.111652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1372/2776] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:54.116308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:54.126097 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f20f2-0855-41b4-83e2-5fefca000cea admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:54.130914 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:54.131509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.131792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.132068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.132734 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:54.134454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd44ac-3603-46b0-bb38-11ed057958d8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:54.145022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1405/2777] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:17:54.148865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:54.158352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7feba4-071a-4327-b304-89e25774858b admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:54.163365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:54.163991 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.164268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.164540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] PATH_INFO: `/v3/projects/6a4a341194664563a6ecec3a9f58069b/users/46e9e019d7c347dc944511978154e96f/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.179195 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4a341194664563a6ecec3a9f58069b, user_id=46e9e019d7c347dc944511978154e96f, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:54.181897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:54.194841 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1373/2778] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:17:54 2022] PUT /identity/v3/projects/6a4a341194664563a6ecec3a9f58069b/users/46e9e019d7c347dc944511978154e96f/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:17:54.205864 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.206148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.206428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.233788 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] MFA Rules not processed for user `46e9e019d7c347dc944511978154e96f`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:54.234980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:54.305495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1406/2779] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:17:54.316245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:54.317995 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:54.375018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b595f9-9b6a-4fd4-85d7-e1d6b6df1811 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:54.378640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:54.379230 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:54.379507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:54.379783 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:54.387860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:54.389327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a826d-5b98-4aab-8a79-4b4612cbd4af service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:54.398278 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1374/2780] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:17:59.758897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:17:59.820326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612b0d3-48d5-4943-b8d4-254ffbf9736d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:17:59.824770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:17:59.825426 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:59.825711 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:59.825986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] PATH_INFO: `/v3/users/46e9e019d7c347dc944511978154e96f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:59.827096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e9e019d7c347dc944511978154e96f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:17:59.829011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:17:59.842213 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:59.876455 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e9e019d7c347dc944511978154e96f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:59.888852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e9e019d7c347dc944511978154e96f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:59.889545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e9e019d7c347dc944511978154e96f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:59.896630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e9e019d7c347dc944511978154e96f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:59.897157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e9e019d7c347dc944511978154e96f'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:17:59.908862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1407/2781] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:17:59 2022] DELETE /identity/v3/users/46e9e019d7c347dc944511978154e96f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:17:59.913927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:17:59.914402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:17:59.914806 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:17:59.934441 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:17:59.935628 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:17:59.978694 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:17:59.996106 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1375/2782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:00.005773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.007150 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:00.062698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0dd06-ccd9-4c32-bd90-cec97d25fa29 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.066298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.066892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.067175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.067446 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.076159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.077616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfc5ab-762a-4db9-9d44-3ddb9e6d2e6f service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.086831 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1408/2783] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:18:00.357760 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.359217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:00.371220 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92a040-45e9-4990-8d66-232bb928114e None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.375854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.376482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.376762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.377037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] PATH_INFO: `/v3/projects/6a4a341194664563a6ecec3a9f58069b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.378252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4a341194664563a6ecec3a9f58069b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.380169 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.426885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4a341194664563a6ecec3a9f58069b', 'request_id': 'req-b20db502-e449-49cf-abfd-f201dc18a05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:18:00.433515 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4a341194664563a6ecec3a9f58069b', 'request_id': 'req-b20db502-e449-49cf-abfd-f201dc18a05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:18:00.439030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4a341194664563a6ecec3a9f58069b', 'request_id': 'req-b20db502-e449-49cf-abfd-f201dc18a05a'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:18:00.449730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] The token cache is being invalidate because project 6a4a341194664563a6ecec3a9f58069b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:18:00.450014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:18:00.450630 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b20db502-e449-49cf-abfd-f201dc18a05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:18:00.452078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1376/2784] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:18:00 2022] DELETE /identity/v3/projects/6a4a341194664563a6ecec3a9f58069b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:18:00.458684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.458969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.459239 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.478622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:00.479828 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:00.536383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1409/2785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:00.543901 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.544190 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.544462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.563388 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:00.564565 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:00.572854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1377/2786] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:00.577943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.588142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4febf-45ac-48ce-a50b-eae25640c912 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.592721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.593360 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.593646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.593953 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.594588 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:18:00.594894 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.596497 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.608639 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1410/2787] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:18:00.613134 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.622105 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b66fc3-30f8-4685-a2b6-2d6c8c8d28fd None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.626643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.627220 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.627495 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.627764 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.628386 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.630818 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.657104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1378/2788] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:18:00 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:18:00.661169 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.670989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756e8f-6204-48e1-9dc1-85973e01452f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.687240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:00.728420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.729026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.729341 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.729619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.730243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.732184 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.756518 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1411/2789] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:18:00 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:18:00.757854 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.768435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3f13a-a0db-466a-851f-a62a2a4745a1 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.774327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.774617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.774897 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.775442 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.776083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.777719 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.788205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1379/2790] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:18:00.792019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.801966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ebea-b337-47b6-9aa6-123078550665 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.806591 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.807165 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.807449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.807732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.808371 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.810021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbb1f5-8d0e-4e27-99a7-84a68aba8748 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.820873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1412/2791] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:18:00.824970 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.835398 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fba7c-d98b-49ed-8ac1-95f3472e3f64 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:00.839969 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:00.840601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.840880 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.841152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] PATH_INFO: `/v3/projects/b760d5d4e60443c48e774ea8b9837ee0/users/e68706a929b24c339a189e207ee375d3/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.855205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b760d5d4e60443c48e774ea8b9837ee0, user_id=e68706a929b24c339a189e207ee375d3, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:00.857865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:00.870777 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1380/2792] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:18:00 2022] PUT /identity/v3/projects/b760d5d4e60443c48e774ea8b9837ee0/users/e68706a929b24c339a189e207ee375d3/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:18:00.876622 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b02b-8597-4995-b5ca-68e8a6aa528d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:00.876984 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b02b-8597-4995-b5ca-68e8a6aa528d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:00.877492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b02b-8597-4995-b5ca-68e8a6aa528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:00.899758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-6fc0b02b-8597-4995-b5ca-68e8a6aa528d None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:00.900961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6fc0b02b-8597-4995-b5ca-68e8a6aa528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:00.957974 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1413/2793] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:18:00.967342 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:00.969096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:01.024972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32ac1-253a-4eeb-b7aa-1c5b24682e34 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:01.028593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:01.029182 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:01.029492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:01.029766 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:01.038746 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:01.040201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:01.049503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1381/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:18:04.969699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:04.970285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:04.970584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:04.999756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] MFA Rules not processed for user `e68706a929b24c339a189e207ee375d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:05.001026 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:05.067269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1414/2795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:05.071912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.082659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040d05-9e01-4a8a-9f21-fe5c5a392e78 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.087514 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.088107 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.088392 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.088669 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.089345 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.091258 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.101682 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:05.121298 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1382/2796] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:18:05 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:18:05.129507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.141652 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1548-6f49-4485-9cf9-c915c900129d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.168661 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:05.201582 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.202225 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.202507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.202781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.203420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.205435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.229345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1415/2797] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:18:05 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:18:05.233748 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.245358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd3ab-589e-48c9-adb4-828900881dc2 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.249920 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.250600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.250885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.251161 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.251810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.253477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.264624 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1383/2798] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:18:05.269011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.280216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c6496-4e74-479c-9cd9-f620f713633e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.295813 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.296852 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.297413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.297932 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] PATH_INFO: `/v3/projects/11560b43711a4ab19942df542d394bd7/users/659dc650b36d4ed28448a4c393a83cc6/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.321253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11560b43711a4ab19942df542d394bd7, user_id=659dc650b36d4ed28448a4c393a83cc6, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.324168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.337579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1416/2799] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:18:05 2022] PUT /identity/v3/projects/11560b43711a4ab19942df542d394bd7/users/659dc650b36d4ed28448a4c393a83cc6/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:18:05.341636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.355313 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11254a6-5782-47e9-9d66-f5eba58a507d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.414975 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.415587 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.415872 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.416146 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.416790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.418603 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924282a-fcfc-44c8-8c2b-e649db87c746 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.430352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1384/2800] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:18:05.434499 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:05.444997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb9333-8837-4c83-b1fd-c9b7394c1318 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:05.449919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:05.450579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:05.450858 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:05.451133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] PATH_INFO: `/v3/projects/11560b43711a4ab19942df542d394bd7/users/659dc650b36d4ed28448a4c393a83cc6/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:05.453039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=11560b43711a4ab19942df542d394bd7, user_id=659dc650b36d4ed28448a4c393a83cc6, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:05.455727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:05.466502 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1417/2801] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:18:05 2022] PUT /identity/v3/projects/11560b43711a4ab19942df542d394bd7/users/659dc650b36d4ed28448a4c393a83cc6/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:18:09.606617 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387d35-ac75-499c-9322-33e374beaac5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:09.607180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387d35-ac75-499c-9322-33e374beaac5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:09.607180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387d35-ac75-499c-9322-33e374beaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:09.637704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-97387d35-ac75-499c-9322-33e374beaac5 None None] MFA Rules not processed for user `659dc650b36d4ed28448a4c393a83cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:09.639019 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-97387d35-ac75-499c-9322-33e374beaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:09.708963 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1385/2802] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:09.723187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:09.723903 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:09.820736 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f668-e89e-42ac-82f5-554943c189fc admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:09.824646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a782cf2bac541d9b83a99b77fafb9bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:09.825176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:09.825490 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:09.825766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:09.886096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:09.887541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:09.896976 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1418/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:18:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:18:10.039805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615ec2-702e-4179-9f26-2396743772cb None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:10.040179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615ec2-702e-4179-9f26-2396743772cb None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:10.040530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd615ec2-702e-4179-9f26-2396743772cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:10.060379 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-cd615ec2-702e-4179-9f26-2396743772cb None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:10.061751 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-cd615ec2-702e-4179-9f26-2396743772cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:10.121356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1386/2804] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:10.170207 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:10.171697 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:10.215052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:10.254440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a38d76-c5e2-4468-9eb6-8b2014ef017c service glance] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:10.259621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:10.260256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:10.260544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:10.260805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:10.271103 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:10.272733 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490fa7e-2d50-4b08-ac2c-7afbdeee9686 service swift] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:10.281917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1419/2805] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:18:19.038219 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:19.038704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:19.038704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:19.046704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:19.059521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] MFA Rules not processed for user `e68706a929b24c339a189e207ee375d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:19.060718 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:19.067745 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1387/2806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:20.277878 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=16 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:21.149464 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:21.149933 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:21.150215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:21.176805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:18:21.178939 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:21.187435 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1420/2807] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:18:21.205786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:21.219286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2040b-c78f-40d4-9f76-c717860d4249 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:21.226451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:21.227297 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:21.227800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:21.228304 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:21.237810 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:21.239687 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:21.248272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1388/2808] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:18:31.169965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:31.244742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=7 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:18:42.654607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:18:42.656034 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:18:42.712806 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168cf4-fb58-4c3d-b35d-f7bc1f18208c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:18:42.716420 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:18:42.717059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:18:42.717368 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:18:42.717645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:18:42.727276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:18:42.728696 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcf7be-6e5f-465e-97bb-b50c8dc53ad4 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:18:42.738556 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1421/2809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:18:52.733823 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=26 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:19:56.180057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:19:56.181526 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:19:56.333674 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca16c0-2f60-497a-ac83-08d7d7721ea4 service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:19:56.338665 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:19:56.339271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:19:56.339678 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:19:56.339815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:19:56.341564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:19:56.353130 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:19:56.354732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:19:56.365418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1389/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:19:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:20:05.102612 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:05.103128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:05.103244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:05.132670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] MFA Rules not processed for user `58e245751afb4ba6a3db98ab30e3ddd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:20:05.133915 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:05.147620 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1422/2811] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:20:05.188698 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:05.199815 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d8e0-cc03-46ee-8556-64e86715948f service placement] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:05.205355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c09cbdb8dd45f49e430fbf5fe59e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:05.205943 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:05.206225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:05.206501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:05.214393 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:05.215946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:05.224354 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1390/2812] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 14:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 14:20:08.610085 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:08.611688 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:08.627185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02038c-29f1-4010-93f2-ec9b9c10571f None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:08.632332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:08.632936 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:08.633245 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:08.633570 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:08.635304 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:08.647720 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:08.649180 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:08.660698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1423/2813] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:20:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:20:11.620192 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:11.721927 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:11.731527 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16349cd-aa1c-4929-a2bc-04add3d983ef service swift] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:11.736457 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:11.737078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:11.737389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:11.737662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] PATH_INFO: `/v3/users/e68706a929b24c339a189e207ee375d3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:11.738758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68706a929b24c339a189e207ee375d3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:11.740663 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:11.792662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68706a929b24c339a189e207ee375d3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:11.807410 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68706a929b24c339a189e207ee375d3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:11.816852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68706a929b24c339a189e207ee375d3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:11.817551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68706a929b24c339a189e207ee375d3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:11.818175 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68706a929b24c339a189e207ee375d3'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:11.832974 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1391/2814] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:20:11 2022] DELETE /identity/v3/users/e68706a929b24c339a189e207ee375d3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:20:12.013100 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:12.025708 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb86b1f-b963-4f17-a5f8-77c1669b2e2b service placement] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:12.104176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:12.104972 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:12.105389 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:12.105789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] PATH_INFO: `/v3/projects/b760d5d4e60443c48e774ea8b9837ee0` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:12.107039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b760d5d4e60443c48e774ea8b9837ee0)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:12.109055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:12.163573 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b760d5d4e60443c48e774ea8b9837ee0', 'request_id': 'req-fa7af229-5c75-4632-8f58-1d5501d43b9c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.170451 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b760d5d4e60443c48e774ea8b9837ee0', 'request_id': 'req-fa7af229-5c75-4632-8f58-1d5501d43b9c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.178825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b760d5d4e60443c48e774ea8b9837ee0', 'request_id': 'req-fa7af229-5c75-4632-8f58-1d5501d43b9c'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.225492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] The token cache is being invalidate because project b760d5d4e60443c48e774ea8b9837ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:20:12.225793 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.226449 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.228563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1424/2815] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:20:12 2022] DELETE /identity/v3/projects/b760d5d4e60443c48e774ea8b9837ee0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:20:12.232898 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:12.234510 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:12.247622 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851abf-8189-482b-8b3f-22932f03a6eb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:12.307334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:12.308057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:12.308456 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:12.308740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] PATH_INFO: `/v3/users/659dc650b36d4ed28448a4c393a83cc6` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:12.309900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=659dc650b36d4ed28448a4c393a83cc6)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:12.311831 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:12.360740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659dc650b36d4ed28448a4c393a83cc6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.372832 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659dc650b36d4ed28448a4c393a83cc6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.381256 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659dc650b36d4ed28448a4c393a83cc6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.381884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659dc650b36d4ed28448a4c393a83cc6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.382497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-f7e0f9f1-43c7-489a-803d-08bcea598d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659dc650b36d4ed28448a4c393a83cc6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.383742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:12.398245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1392/2816] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:20:12 2022] DELETE /identity/v3/users/659dc650b36d4ed28448a4c393a83cc6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:20:12.598061 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:20:12.600466 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:12.620142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af229-5c75-4632-8f58-1d5501d43b9c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:20:12.679243 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:12.698217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:20:12.699682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:12.700041 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:12.700419 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] PATH_INFO: `/v3/projects/11560b43711a4ab19942df542d394bd7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:12.702142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11560b43711a4ab19942df542d394bd7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:20:12.704758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:20:12.788372 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11560b43711a4ab19942df542d394bd7', 'request_id': 'req-5e867c82-67ff-45cf-ab33-d6d6b819062e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.795801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11560b43711a4ab19942df542d394bd7', 'request_id': 'req-5e867c82-67ff-45cf-ab33-d6d6b819062e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.804437 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11560b43711a4ab19942df542d394bd7', 'request_id': 'req-5e867c82-67ff-45cf-ab33-d6d6b819062e'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.819844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] The token cache is being invalidate because project 11560b43711a4ab19942df542d394bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:20:12.820132 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.820811 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:20:12.822621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1425/2817] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:20:12 2022] DELETE /identity/v3/projects/11560b43711a4ab19942df542d394bd7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:20:15.353210 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:20:15.353739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:20:15.353849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:20:15.373208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] MFA Rules not processed for user `d0245460724a442292f738e7e947c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:20:15.374426 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:20:15.431593 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1393/2818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:20:22.815929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:20:25.424196 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=30 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:18.002967 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:18.004801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:18.083158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e867c82-67ff-45cf-ab33-d6d6b819062e admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:18.086956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:18.087553 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:18.087829 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:18.088098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:18.089921 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:18.175386 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:18.176824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:18.197762 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1426/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:19.379784 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:19.381301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:19.393152 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8703df7-a30c-48fd-9cd0-db4ca13f3745 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:19.397150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:19.397881 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:19.398071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:19.398343 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:19.400031 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:19.414399 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:19.416030 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:19.427037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1394/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:24.522531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:24.525912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:24.614395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2479d4-2037-44c0-901f-62e6ffef69d6 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:24.619252 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:24.619912 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:24.620189 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:24.620459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] PATH_INFO: `/v3/users/d0245460724a442292f738e7e947c87b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:24.623924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0245460724a442292f738e7e947c87b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:24.623924 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:24.625997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=100 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:24.671400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0245460724a442292f738e7e947c87b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:24.683695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0245460724a442292f738e7e947c87b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:24.684405 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0245460724a442292f738e7e947c87b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:24.694141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0245460724a442292f738e7e947c87b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:24.694789 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-7663fc99-f41f-4fc4-9c58-3c311d200d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0245460724a442292f738e7e947c87b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:24.708266 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1427/2821] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:24 2022] DELETE /identity/v3/users/d0245460724a442292f738e7e947c87b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:24.888228 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:24.902590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa358d-d96a-4cbf-84fa-94a02a7e6b56 service neutron] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:24.961725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:24.962364 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:24.962651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:24.962931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] PATH_INFO: `/v3/projects/0e782ea111b44143a77f16c4846bb5e3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:24.964062 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e782ea111b44143a77f16c4846bb5e3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:24.966024 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.013000 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e782ea111b44143a77f16c4846bb5e3', 'request_id': 'req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:25.020425 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e782ea111b44143a77f16c4846bb5e3', 'request_id': 'req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:25.026336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e782ea111b44143a77f16c4846bb5e3', 'request_id': 'req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:25.038121 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] The token cache is being invalidate because project 0e782ea111b44143a77f16c4846bb5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:25.038414 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:25.039057 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e6d6d8a5-8309-4e5e-b0ae-0c4bd7e7871c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:25.040555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1395/2822] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:24 2022] DELETE /identity/v3/projects/0e782ea111b44143a77f16c4846bb5e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:25.045629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.045991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.046334 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.106905 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:25.108119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:25.183750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1428/2823] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:25.185557 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.185851 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.186133 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.208939 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:25.210453 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:25.225061 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1396/2824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:25.229149 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.239403 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707620f9-e926-4f84-8aa4-a13d5aa784f2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.244017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.244632 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.244916 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.245185 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.245890 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:21:25.246191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.247798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.261117 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1429/2825] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:21:25.265271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.276805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938c7f-0f47-496b-aa86-0afefd0e827b None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.281874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.282492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.282774 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.283222 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.283885 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.286475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.329145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1397/2826] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:25 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:25.333554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.344081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f14e4-078a-4227-8a0a-349945830a41 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.377725 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:25.403825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.404362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.404644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.404919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.405625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.407544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.434051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1430/2827] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:25 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:25.435225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.445481 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32173c0-5c9a-459f-976b-6ef8d73b510c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.450216 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.450813 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.451128 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.451478 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.452213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.454044 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.464609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1398/2828] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:25.468741 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.479308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de8408-81ea-47e7-82dc-af6d30e5c2a0 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.483978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.484575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.484853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.485124 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.485797 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.487644 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea51b85-2692-4fb9-bc1a-6beaf754896e admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.497689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1431/2829] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:25.501834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.511786 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94cb9-8ab2-4a24-ba90-de5db4591a19 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.516454 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.517100 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.517416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.517697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] PATH_INFO: `/v3/projects/e7cac69cec144c8c8625d2f89ce8237a/users/3a7b1d8d3e414781a4b0ac40b0f93f8b/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.532770 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cac69cec144c8c8625d2f89ce8237a, user_id=3a7b1d8d3e414781a4b0ac40b0f93f8b, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.536140 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.548869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1399/2830] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:25 2022] PUT /identity/v3/projects/e7cac69cec144c8c8625d2f89ce8237a/users/3a7b1d8d3e414781a4b0ac40b0f93f8b/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:25.559105 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.559636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.559636 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.588630 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] MFA Rules not processed for user `3a7b1d8d3e414781a4b0ac40b0f93f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:25.589901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:25.668047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1432/2831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:21:25.679740 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:25.681470 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:25.689474 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:25.770700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589cf0a-bf56-493a-8f1b-d9d61a939104 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:25.776473 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0984655bd84440f0b4baf516e7be88b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:25.777090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:25.777402 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:25.777675 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:25.790188 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:25.791978 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:25.802165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1400/2832] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:21:27.552784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:27.555801 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:27.632680 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b032f0-e11e-4c0f-b2a6-5020507bddf4 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:27.637541 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:27.638175 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:27.638457 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:27.638784 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] PATH_INFO: `/v3/users/db1ece6236d04eddbb87c7e43f3f7e42` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:27.639937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1ece6236d04eddbb87c7e43f3f7e42)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:27.641950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:27.688001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1ece6236d04eddbb87c7e43f3f7e42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:27.689128 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:27.702418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1ece6236d04eddbb87c7e43f3f7e42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:27.703125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1ece6236d04eddbb87c7e43f3f7e42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:27.711233 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1ece6236d04eddbb87c7e43f3f7e42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:27.712075 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1ece6236d04eddbb87c7e43f3f7e42'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:27.725337 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1433/2833] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:27 2022] DELETE /identity/v3/users/db1ece6236d04eddbb87c7e43f3f7e42 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:27.905396 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:27.923700 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b04236-53b1-4b53-94ff-54929f57e89f service nova] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:27.987594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:27.988236 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:27.988575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:27.988838 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] PATH_INFO: `/v3/projects/301ae8617218468c977da95e02cb75ee` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:27.989887 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301ae8617218468c977da95e02cb75ee)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:27.991873 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:28.037664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301ae8617218468c977da95e02cb75ee', 'request_id': 'req-e7b3c37d-1a85-404f-8348-5c3b074111b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.044736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301ae8617218468c977da95e02cb75ee', 'request_id': 'req-e7b3c37d-1a85-404f-8348-5c3b074111b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.050443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301ae8617218468c977da95e02cb75ee', 'request_id': 'req-e7b3c37d-1a85-404f-8348-5c3b074111b6'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.061282 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] The token cache is being invalidate because project 301ae8617218468c977da95e02cb75ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:28.061575 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.062217 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.063790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1401/2834] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:27 2022] DELETE /identity/v3/projects/301ae8617218468c977da95e02cb75ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:28.068355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:28.069781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:28.083062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5936-5e94-47ae-9f5c-6b01949dd0e8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:28.137532 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:28.138159 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:28.138440 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:28.138716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] PATH_INFO: `/v3/users/00f6cfeb11b04bdeac9d1211f33dc447` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:28.139839 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f6cfeb11b04bdeac9d1211f33dc447)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:28.141798 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:28.187809 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f6cfeb11b04bdeac9d1211f33dc447'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.199732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f6cfeb11b04bdeac9d1211f33dc447'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.200397 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f6cfeb11b04bdeac9d1211f33dc447'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.207893 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f6cfeb11b04bdeac9d1211f33dc447'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.208698 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f6cfeb11b04bdeac9d1211f33dc447'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.220730 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1434/2835] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:28 2022] DELETE /identity/v3/users/00f6cfeb11b04bdeac9d1211f33dc447 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:28.390540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:28.391982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:28.404444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c37d-1a85-404f-8348-5c3b074111b6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:28.421173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:28.464255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:28.464888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:28.465172 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:28.465487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] PATH_INFO: `/v3/projects/7c8432beb21948caaff646343339d88e` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:28.466599 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8432beb21948caaff646343339d88e)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:28.468512 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:28.513720 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8432beb21948caaff646343339d88e', 'request_id': 'req-65ca61cf-712e-489c-aee3-6a8caec543b5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.520635 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8432beb21948caaff646343339d88e', 'request_id': 'req-65ca61cf-712e-489c-aee3-6a8caec543b5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.526205 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8432beb21948caaff646343339d88e', 'request_id': 'req-65ca61cf-712e-489c-aee3-6a8caec543b5'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.536976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] The token cache is being invalidate because project 7c8432beb21948caaff646343339d88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:28.537287 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.537910 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-65ca61cf-712e-489c-aee3-6a8caec543b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.539391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1402/2836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:28 2022] DELETE /identity/v3/projects/7c8432beb21948caaff646343339d88e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:28.643686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:28.643686 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:28.654454 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7f95-25d4-4da3-959d-24f05ec9d751 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:28.703123 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:28.719920 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:28.720579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:28.720861 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:28.721134 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] PATH_INFO: `/v3/users/3a7b1d8d3e414781a4b0ac40b0f93f8b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:28.723220 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7b1d8d3e414781a4b0ac40b0f93f8b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:28.725299 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:28.778001 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7b1d8d3e414781a4b0ac40b0f93f8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.792263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7b1d8d3e414781a4b0ac40b0f93f8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.792998 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7b1d8d3e414781a4b0ac40b0f93f8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.801253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7b1d8d3e414781a4b0ac40b0f93f8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.801978 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7b1d8d3e414781a4b0ac40b0f93f8b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:28.814351 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1435/2837] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:28 2022] DELETE /identity/v3/users/3a7b1d8d3e414781a4b0ac40b0f93f8b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:28.818779 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:28.819066 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:28.819340 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:28.838147 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:28.839349 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:28.900655 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1403/2838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:28.910850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:28.912287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:28.968961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322266c-8b4e-479e-b077-4443856cd7be admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:28.973164 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:28.973796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:28.974088 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:28.974356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:28.983326 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:28.984751 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b35092-58d7-48af-8bc6-c822320f56fd service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:28.995083 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1436/2839] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:29.258083 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.259568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:29.271993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d583c8-576d-452f-98ac-19d54de27fba None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.276656 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.277307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.277594 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.277877 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] PATH_INFO: `/v3/projects/e7cac69cec144c8c8625d2f89ce8237a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.279131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cac69cec144c8c8625d2f89ce8237a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.281043 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.323914 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:29.326971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cac69cec144c8c8625d2f89ce8237a', 'request_id': 'req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:29.334971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cac69cec144c8c8625d2f89ce8237a', 'request_id': 'req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:29.340613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cac69cec144c8c8625d2f89ce8237a', 'request_id': 'req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:29.352070 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] The token cache is being invalidate because project e7cac69cec144c8c8625d2f89ce8237a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:29.352360 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:29.352985 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e52d2eb7-1fb6-434c-bf54-08edb184ff4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:29.354477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1404/2840] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:29 2022] DELETE /identity/v3/projects/e7cac69cec144c8c8625d2f89ce8237a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:29.359302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.359592 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.359871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.379407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:29.380615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:29.438529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1437/2841] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:29.446480 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.446773 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.447052 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.466941 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:29.468139 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:29.476018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1405/2842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:29.479950 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.489919 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db5ae1-0d1d-4e4d-8c1d-d61a307ddec9 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.494545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.495142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.495428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.495703 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.496349 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:21:29.496656 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.498318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.499727 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:29.512011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1438/2843] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 14:21:29.516123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.526035 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5e040-4a07-411c-993e-da0691bddd11 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.530715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.531332 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.531613 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.531884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.532516 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.535352 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.567521 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1406/2844] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:29.571794 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.581732 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d383b9-f890-44ac-9764-cef9c2ccd4b8 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.637693 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.638291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.638576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.638848 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.639469 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.641404 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.662289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1439/2845] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:29.666567 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.677148 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1e7a-6469-4c2e-afc5-d72cb6f07147 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.681711 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.682295 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.682572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.682845 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.683477 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.685037 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.694702 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1407/2846] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:29.698433 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.708216 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5193e-bf2e-4002-83cf-2b36631dbe4f admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.712780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.713400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.713684 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.713960 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.714597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.716171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd786d0e-89d8-40e7-a9dd-8676f8fe25b0 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.726327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1440/2847] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:29.730302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.740883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087375d-f1d3-45fb-a00d-404274f47499 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.745458 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.746087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.746365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.746640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] PATH_INFO: `/v3/projects/16f02547290b4f2a859c02f5a9e5ca9f/users/39a6b048d4774adba368008fe225805d/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.761104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f02547290b4f2a859c02f5a9e5ca9f, user_id=39a6b048d4774adba368008fe225805d, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.763765 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.779252 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1408/2848] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:29 2022] PUT /identity/v3/projects/16f02547290b4f2a859c02f5a9e5ca9f/users/39a6b048d4774adba368008fe225805d/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:21:29.789587 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.789892 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.790171 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.819841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] MFA Rules not processed for user `39a6b048d4774adba368008fe225805d`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:29.821045 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:29.886156 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1441/2849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:29.890704 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:29.951652 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122dace-55b9-4cc5-9a0c-8facd5683452 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:29.956244 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:29.956833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:29.957117 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:29.957417 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:29.958036 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:29.959929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:29.985189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1409/2850] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:29.990202 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.000689 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79440f-2d1a-4893-aa72-98644ca4aaf2 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.055072 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.055676 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.055956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.056231 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.056881 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.058844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.068092 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:30.080566 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1442/2851] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:29 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:30.084504 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.094487 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6eb0-8be3-4147-a9d7-897d1656cb06 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.098980 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.099564 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.099843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.100113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.100739 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.102355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.113423 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1410/2852] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:30.117327 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.127068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4ede5-f610-4a17-94d5-dec141308d50 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.132654 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.133336 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.133616 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.133888 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] PATH_INFO: `/v3/projects/da0dc768c5974282baec3184192a927c/users/532621ee79614cd5930ac881debcd8e7/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.148163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dc768c5974282baec3184192a927c, user_id=532621ee79614cd5930ac881debcd8e7, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.150835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.163415 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1443/2853] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:30 2022] PUT /identity/v3/projects/da0dc768c5974282baec3184192a927c/users/532621ee79614cd5930ac881debcd8e7/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:30.167253 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.177729 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db60d5e-5262-45f1-b853-c528587c30c6 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.220544 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:30.237932 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.238528 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.239800 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.240069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.240730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.242307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e78-2fbb-4dad-9b61-5f2440ed2ac3 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.251860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1411/2854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:30.256118 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.266084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd6338-16ce-4d86-8dbc-082d80348d4d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.270626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.271263 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.271539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.271814 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] PATH_INFO: `/v3/projects/da0dc768c5974282baec3184192a927c/users/532621ee79614cd5930ac881debcd8e7/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.273699 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0dc768c5974282baec3184192a927c, user_id=532621ee79614cd5930ac881debcd8e7, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.276303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.287285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1444/2855] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:30 2022] PUT /identity/v3/projects/da0dc768c5974282baec3184192a927c/users/532621ee79614cd5930ac881debcd8e7/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:30.298213 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.298706 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.298805 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.326307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] MFA Rules not processed for user `532621ee79614cd5930ac881debcd8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:30.327530 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:30.394020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1412/2856] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:30.405205 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.406965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:30.483176 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c35d9-a608-42b6-ad79-4706837ee26d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.487052 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.488217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.488494 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.488765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.497399 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.498815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.508096 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1445/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:30.584537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:30.594380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202861a-77c3-44c3-be32-d57be452d6e7 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:30.598503 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:30.599093 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:30.599376 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:30.599651 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:30.654145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:30.655586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e58da-5520-4a5c-bceb-c3d14bea9e65 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:30.665329 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1413/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:40.503896 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:INSERT=4,keystone:SELECT=52 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:40.661198 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=71 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:45.418425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:45.478302 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5fe6a-06ac-4a53-a246-d24edec66535 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:45.482781 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:45.483401 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:45.483681 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:45.483956 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] PATH_INFO: `/v3/users/39a6b048d4774adba368008fe225805d` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:45.485055 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a6b048d4774adba368008fe225805d)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:45.487022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:45.534568 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a6b048d4774adba368008fe225805d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:45.546191 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a6b048d4774adba368008fe225805d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:45.546935 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a6b048d4774adba368008fe225805d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:45.554436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a6b048d4774adba368008fe225805d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:45.555071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a6b048d4774adba368008fe225805d'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:45.566927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1446/2859] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:45 2022] DELETE /identity/v3/users/39a6b048d4774adba368008fe225805d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:45.572063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:45.572555 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:45.572664 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:45.593240 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:45.594956 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:45.653558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1414/2860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:21:45.663834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:45.665270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:45.720966 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaa3df-6e1b-41b5-993c-2e432fd63368 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:45.724626 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:45.726036 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:45.726660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:45.726660 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:45.737597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:45.739078 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:45.748994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1447/2861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 14:21:46.015234 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.016645 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:46.030933 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52d863-e6f6-4897-ace7-c7c17b40a470 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.035540 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.036162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.036445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.036716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] PATH_INFO: `/v3/projects/16f02547290b4f2a859c02f5a9e5ca9f` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.037918 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f02547290b4f2a859c02f5a9e5ca9f)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.039825 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:46.086302 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f02547290b4f2a859c02f5a9e5ca9f', 'request_id': 'req-90ab505d-9ce7-49c2-bd4c-f56466713927'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.093762 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f02547290b4f2a859c02f5a9e5ca9f', 'request_id': 'req-90ab505d-9ce7-49c2-bd4c-f56466713927'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.099909 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f02547290b4f2a859c02f5a9e5ca9f', 'request_id': 'req-90ab505d-9ce7-49c2-bd4c-f56466713927'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.110787 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] The token cache is being invalidate because project 16f02547290b4f2a859c02f5a9e5ca9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:46.111077 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.111703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.113462 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1415/2862] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:46 2022] DELETE /identity/v3/projects/16f02547290b4f2a859c02f5a9e5ca9f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:46.117503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.126989 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696b02e-8cba-4af4-8bd2-6b43298e4d89 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.144898 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:46.188390 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.189023 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.189343 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.189619 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] PATH_INFO: `/v3/users/532621ee79614cd5930ac881debcd8e7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.190843 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=532621ee79614cd5930ac881debcd8e7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.192868 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:46.238770 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532621ee79614cd5930ac881debcd8e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.250895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532621ee79614cd5930ac881debcd8e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.251545 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532621ee79614cd5930ac881debcd8e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.259594 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532621ee79614cd5930ac881debcd8e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.260227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-10249c40-59d8-4f6e-92e9-f2ac4737d2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532621ee79614cd5930ac881debcd8e7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.272310 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1448/2863] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:46 2022] DELETE /identity/v3/users/532621ee79614cd5930ac881debcd8e7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:46.540703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.542221 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:46.556151 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab505d-9ce7-49c2-bd4c-f56466713927 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.614254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.614958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.615143 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.615448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] PATH_INFO: `/v3/projects/da0dc768c5974282baec3184192a927c` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.616558 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0dc768c5974282baec3184192a927c)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.618486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:46.649730 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:46.667218 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0dc768c5974282baec3184192a927c', 'request_id': 'req-dc318997-e114-44d7-9ee0-c22832772c32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.674551 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0dc768c5974282baec3184192a927c', 'request_id': 'req-dc318997-e114-44d7-9ee0-c22832772c32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.680758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0dc768c5974282baec3184192a927c', 'request_id': 'req-dc318997-e114-44d7-9ee0-c22832772c32'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.691572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] The token cache is being invalidate because project da0dc768c5974282baec3184192a927c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:46.691861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.692498 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-dc318997-e114-44d7-9ee0-c22832772c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:46.694497 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1416/2864] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:46 2022] DELETE /identity/v3/projects/da0dc768c5974282baec3184192a927c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:46.699395 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.699866 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.699994 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.719862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:46.720982 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:46.785716 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1449/2865] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:46.793878 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.794159 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.794431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.814010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:46.815208 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:46.823546 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1417/2866] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:46.827724 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.838080 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bda5-a97b-4e73-ae19-2cbe91e79185 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.842624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a76d44-f588-4092-8412-214919732aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.843212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76d44-f588-4092-8412-214919732aec admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.843492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76d44-f588-4092-8412-214919732aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.843766 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76d44-f588-4092-8412-214919732aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.844442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a76d44-f588-4092-8412-214919732aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:21:46.844745 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a76d44-f588-4092-8412-214919732aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.846365 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a76d44-f588-4092-8412-214919732aec admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:46.857871 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1450/2867] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:21:46.861958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.871211 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66929e-ed81-45d7-bbb2-aeb41f186208 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.875802 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.876378 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.876654 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.876922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.877586 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.879466 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:46.906341 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1418/2868] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:46 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:46.910407 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a76d44-f588-4092-8412-214919732aec admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:46.920267 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a76d44-f588-4092-8412-214919732aec admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:46.945506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:46.977723 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:46.978317 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:46.978600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:46.978876 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:46.979506 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:46.981442 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.002101 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1451/2869] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:46 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:47.006849 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.016821 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914361ea-6c35-4840-99fe-aaca17ad2dca admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.021377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.021960 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.022270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.022542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.023174 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.024742 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.034268 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1419/2870] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:47.037965 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.047597 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e90b5-3a2c-4553-bb86-f22d7575607d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.052141 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.052729 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.053564 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.053834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.054459 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.056038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a245a-e26b-4cc7-b68b-c39e46177139 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.065646 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1452/2871] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 14:21:47.070344 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.080513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1243920-2cb2-4572-8657-fee33adc5d21 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.085103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.085767 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.086047 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.086318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] PATH_INFO: `/v3/projects/00c75a97d4d1451390a97165e432c982/users/8b806d789ae24ae8bb328ed6c7e0f195/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.100448 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c75a97d4d1451390a97165e432c982, user_id=8b806d789ae24ae8bb328ed6c7e0f195, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.103115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.117443 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1420/2872] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:47 2022] PUT /identity/v3/projects/00c75a97d4d1451390a97165e432c982/users/8b806d789ae24ae8bb328ed6c7e0f195/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:47.128838 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.129120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.129424 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.156986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] MFA Rules not processed for user `8b806d789ae24ae8bb328ed6c7e0f195`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:47.158217 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:47.220655 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1453/2873] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:47.225710 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.286021 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6120-1ab8-49d8-80f1-d8d02fc49af0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.290545 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.291165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.291449 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.291725 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.292355 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.294279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.320653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1421/2874] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:47 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:47.324695 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.335212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e24a-6023-40fa-9464-a869e14c032b None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.389507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.390125 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.390406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.390682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.391315 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.393253 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.414835 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1454/2875] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:47 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:47.418482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.429104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc14d-d9c0-424e-86b6-f522ee09f66a admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.433717 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.434301 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.434579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.434847 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.435486 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.437053 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.447255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1422/2876] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:47.451285 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.461179 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2a19-9be1-44e3-84e6-57ef2242328c admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.465830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.466470 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.466750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.467051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] PATH_INFO: `/v3/projects/936226965bcc4cc18330301bdc06a587/users/adfcaaef9d4745f48bbdbf49570d8650/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.482024 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936226965bcc4cc18330301bdc06a587, user_id=adfcaaef9d4745f48bbdbf49570d8650, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.484929 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.498259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1455/2877] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:47 2022] PUT /identity/v3/projects/936226965bcc4cc18330301bdc06a587/users/adfcaaef9d4745f48bbdbf49570d8650/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:21:47.502073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.511697 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316461b3-32b5-4c16-9648-65ff624e8814 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.530505 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:47.568583 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.569104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.569420 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.569692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.570483 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.572055 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b0970-8d0a-4f89-99fe-2686bbc5e000 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.581542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1423/2878] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:47.585855 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.592262 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:47.598193 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fba2c-1634-4ac5-94e4-b122a5908d95 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.604629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.605458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.605739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.606019 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] PATH_INFO: `/v3/projects/936226965bcc4cc18330301bdc06a587/users/adfcaaef9d4745f48bbdbf49570d8650/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.608027 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936226965bcc4cc18330301bdc06a587, user_id=adfcaaef9d4745f48bbdbf49570d8650, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.610758 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.623460 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1456/2879] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:47 2022] PUT /identity/v3/projects/936226965bcc4cc18330301bdc06a587/users/adfcaaef9d4745f48bbdbf49570d8650/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:47.634115 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.634703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.634703 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.666162 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] MFA Rules not processed for user `adfcaaef9d4745f48bbdbf49570d8650`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:47.667433 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:47.751073 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1424/2880] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:47.768625 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.770352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:47.834917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d388b-62b4-41e8-b043-693879badef4 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.838512 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.839071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.839352 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.839628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.848480 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.850539 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.860212 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1457/2881] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:47.907408 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:47.908962 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:47.921274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5815c-e02e-43e9-9170-66dbd662c688 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:47.924993 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:47.925642 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:47.925931 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:47.926201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:47.983811 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:47.985272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa70e3-e0ba-4fa3-8e7a-51826a97f7d4 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:47.994790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1425/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:51.311844 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:51.382270 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932e94d-c19c-498e-b711-a752b545bfc7 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:51.387430 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:51.388084 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:51.388406 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:51.388679 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] PATH_INFO: `/v3/users/8b806d789ae24ae8bb328ed6c7e0f195` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:51.389820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b806d789ae24ae8bb328ed6c7e0f195)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:51.391816 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:51.444513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b806d789ae24ae8bb328ed6c7e0f195'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:51.457542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b806d789ae24ae8bb328ed6c7e0f195'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:51.458272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b806d789ae24ae8bb328ed6c7e0f195'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:51.466531 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b806d789ae24ae8bb328ed6c7e0f195'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:51.467596 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b806d789ae24ae8bb328ed6c7e0f195'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:51.482338 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1458/2883] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:51 2022] DELETE /identity/v3/users/8b806d789ae24ae8bb328ed6c7e0f195 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:51.487187 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:51.487929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:51.488063 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:51.507790 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:51.509010 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:51.554520 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=100 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:51.573507 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1426/2884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:51.583567 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:51.585747 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:51.601635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:51.650356 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec490-94a9-40ee-b112-798bd5aab90b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:51.655465 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:51.656077 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:51.656359 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:51.656633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:51.665773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:51.667244 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:51.679635 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1459/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:51.966274 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:51.967715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:51.980976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53731b61-9299-4d85-8bfa-d58c0d3da650 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:51.985640 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:51.986307 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:51.986590 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:51.986864 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] PATH_INFO: `/v3/projects/00c75a97d4d1451390a97165e432c982` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:51.988248 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c75a97d4d1451390a97165e432c982)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:51.991406 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.045069 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c75a97d4d1451390a97165e432c982', 'request_id': 'req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.054611 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c75a97d4d1451390a97165e432c982', 'request_id': 'req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.060358 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c75a97d4d1451390a97165e432c982', 'request_id': 'req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.090385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] The token cache is being invalidate because project 00c75a97d4d1451390a97165e432c982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:52.090673 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.091336 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.092827 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1427/2886] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:51 2022] DELETE /identity/v3/projects/00c75a97d4d1451390a97165e432c982 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:52.096804 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:52.106834 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e592a-08df-4f57-b069-fc5d8f01d110 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:52.164376 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:52.165007 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.165320 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.165599 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] PATH_INFO: `/v3/users/adfcaaef9d4745f48bbdbf49570d8650` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.166713 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfcaaef9d4745f48bbdbf49570d8650)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:52.168647 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.212628 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfcaaef9d4745f48bbdbf49570d8650'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.224196 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfcaaef9d4745f48bbdbf49570d8650'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.225413 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfcaaef9d4745f48bbdbf49570d8650'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.232607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfcaaef9d4745f48bbdbf49570d8650'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.233215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-95b5c7a3-777a-49fa-95bd-5af108eac72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfcaaef9d4745f48bbdbf49570d8650'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.246673 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1460/2887] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:52 2022] DELETE /identity/v3/users/adfcaaef9d4745f48bbdbf49570d8650 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:52.526380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:52.527865 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:52.542929 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e0fbe-d988-4fdc-bf95-bdc0ff79ad7d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:52.603913 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:52.604460 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.604741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.605013 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] PATH_INFO: `/v3/projects/936226965bcc4cc18330301bdc06a587` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.606179 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936226965bcc4cc18330301bdc06a587)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:52.608103 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.653445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936226965bcc4cc18330301bdc06a587', 'request_id': 'req-df38f89b-92dd-471a-9bad-e682c0445978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.660844 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936226965bcc4cc18330301bdc06a587', 'request_id': 'req-df38f89b-92dd-471a-9bad-e682c0445978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.666315 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936226965bcc4cc18330301bdc06a587', 'request_id': 'req-df38f89b-92dd-471a-9bad-e682c0445978'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.673123 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:52.679615 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] The token cache is being invalidate because project 936226965bcc4cc18330301bdc06a587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:52.679972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.680616 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-df38f89b-92dd-471a-9bad-e682c0445978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:52.682389 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1428/2888] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:52 2022] DELETE /identity/v3/projects/936226965bcc4cc18330301bdc06a587 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:52.687513 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.688017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.688140 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.707607 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:52.708786 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:52.736700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:52.769436 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1461/2889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:52.777490 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af284b-3ab7-4afb-9509-193c575377de None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.777778 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af284b-3ab7-4afb-9509-193c575377de None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.778060 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af284b-3ab7-4afb-9509-193c575377de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.797860 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-51af284b-3ab7-4afb-9509-193c575377de None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:52.799056 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51af284b-3ab7-4afb-9509-193c575377de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:52.806899 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1429/2890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:52.811038 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:52.821071 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f1d1b-fc28-4872-b69d-fd51ca100d1c None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:52.825544 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:52.826133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.826410 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.826682 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.827322 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:21:52.827624 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:52.829259 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.841068 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1462/2891] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:21:52.845254 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af284b-3ab7-4afb-9509-193c575377de None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:52.854741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af284b-3ab7-4afb-9509-193c575377de None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:52.859300 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:52.859883 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.860165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.860437 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.861064 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:52.863260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.889846 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1430/2892] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:21:52.893963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:52.904355 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f97f8-8c6a-4804-be36-7e399f94734a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:52.964187 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:52.964782 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:52.965060 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:52.965362 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:52.965986 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:52.967897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:52.989051 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1463/2893] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:52 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:52.993780 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.003874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82245f-91b5-4bd4-9b83-cceb13d335eb admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.009071 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.009696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.009982 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.010261 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.010900 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.012499 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.022189 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1431/2894] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:53.025847 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.035615 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d6126-82a5-4386-a03f-0da2bdb82578 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.040133 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.040714 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.040996 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.041306 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.041937 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.043542 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0806af-486f-46c8-bb1f-1fc589defa8d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.054257 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1464/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:53.057947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.067680 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd4ac-edd0-4568-980b-ad96b3df8bab admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.072858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.073513 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.073798 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.074076 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] PATH_INFO: `/v3/projects/4ff91046396d4393bd776405df6bc8c8/users/3b4dd79b4ac64bddb1acdb1278f6f14a/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.088279 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff91046396d4393bd776405df6bc8c8, user_id=3b4dd79b4ac64bddb1acdb1278f6f14a, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.090977 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.104693 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1432/2896] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:53 2022] PUT /identity/v3/projects/4ff91046396d4393bd776405df6bc8c8/users/3b4dd79b4ac64bddb1acdb1278f6f14a/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:21:53.169428 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.169645 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.169886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.198318 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] MFA Rules not processed for user `3b4dd79b4ac64bddb1acdb1278f6f14a`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:53.199522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:53.261873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1465/2897] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:53.266326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.328601 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3fdec-f02f-4dc0-acb7-63cf9e1e0ea5 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.333201 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.333834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.334114 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.334387 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.335027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.336928 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.363447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1433/2898] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:53 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:53.368073 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.378722 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32cc20-0271-4f67-aaf4-855c95f5c024 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.403670 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:53.435408 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.435943 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.436222 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.436492 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.437119 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.439050 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.462111 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1466/2899] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:53 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:53.463271 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.473334 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b211817-0fc0-41a6-b3e5-1a1fd1529c32 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.478371 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.478950 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.479327 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.479606 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.480238 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.482319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.493552 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1434/2900] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:53.497603 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.507298 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43233b0f-4c5e-4978-9685-fcbe7a15fd75 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.511865 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.512507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.512787 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.513062 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] PATH_INFO: `/v3/projects/435c5eaa0db54b7281685f37dc704188/users/7bfcae4ffe5a4b0b813bab618b716f2b/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.527886 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=435c5eaa0db54b7281685f37dc704188, user_id=7bfcae4ffe5a4b0b813bab618b716f2b, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.530602 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.543726 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1467/2901] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:53 2022] PUT /identity/v3/projects/435c5eaa0db54b7281685f37dc704188/users/7bfcae4ffe5a4b0b813bab618b716f2b/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:53.547671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.558224 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc4080-7ca2-484d-847e-18a25970c078 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.613971 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.614571 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.614855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.615132 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.616326 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.617961 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea4442-be05-4c58-985c-88e2512e07bb admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.627372 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1435/2902] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:53.631504 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.641584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e33a-571c-47ea-a743-c1a7fde61c9a admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.646385 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.647022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.647303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.647575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] PATH_INFO: `/v3/projects/435c5eaa0db54b7281685f37dc704188/users/7bfcae4ffe5a4b0b813bab618b716f2b/roles/7cd2a85ba9004397b74226de1219a45f` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.649500 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435c5eaa0db54b7281685f37dc704188, user_id=7bfcae4ffe5a4b0b813bab618b716f2b, role_id=7cd2a85ba9004397b74226de1219a45f)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.652163 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.662739 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1468/2903] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:53 2022] PUT /identity/v3/projects/435c5eaa0db54b7281685f37dc704188/users/7bfcae4ffe5a4b0b813bab618b716f2b/roles/7cd2a85ba9004397b74226de1219a45f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:53.672390 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.672681 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.672958 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.681501 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:53.701322 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] MFA Rules not processed for user `7bfcae4ffe5a4b0b813bab618b716f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:53.702459 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:53.768754 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1436/2904] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:53.779979 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.781756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:53.837980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3de90-6c69-4cc3-8c3b-dd0cd17e7306 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.841643 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.842240 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.842522 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.842795 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:53.852418 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:53.853895 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:53.863495 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1469/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:53.965819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:53.975435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de1125-401d-4112-9739-36c1ac9f203d None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:53.979259 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:53.979855 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:53.980138 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:53.980415 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:54.036072 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:54.038145 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79fab-a0d8-45bc-9e3f-64398ffd9d3b service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:54.046834 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1437/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:56.624796 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:56.685748 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8717b-2620-4e0c-b9bf-4922ea85ee06 service cinder] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:56.690256 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:56.690873 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:56.691154 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:56.691427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] PATH_INFO: `/v3/users/3b4dd79b4ac64bddb1acdb1278f6f14a` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:56.692525 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4dd79b4ac64bddb1acdb1278f6f14a)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:56.694519 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:56.720997 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:56.741168 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4dd79b4ac64bddb1acdb1278f6f14a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:56.753029 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4dd79b4ac64bddb1acdb1278f6f14a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:56.753731 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4dd79b4ac64bddb1acdb1278f6f14a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:56.760884 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4dd79b4ac64bddb1acdb1278f6f14a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:56.761514 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4dd79b4ac64bddb1acdb1278f6f14a'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:56.775208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1470/2907] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:56 2022] DELETE /identity/v3/users/3b4dd79b4ac64bddb1acdb1278f6f14a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:56.779747 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:56.780200 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:56.780325 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:56.801362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:56.802553 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:56.859731 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1438/2908] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:56.869574 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:56.871021 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:56.926537 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5aaf94-8e70-43ce-8355-0fe714031a01 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:56.930162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:56.930759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:56.931040 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:56.931311 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:56.940009 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:56.941458 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:56.950554 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1471/2909] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:21:57.212875 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:57.214418 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:57.228173 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f1dae-bfed-4b7a-a6b0-86a3f21653fa None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:57.232716 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:57.234096 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:57.234385 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:57.234657 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] PATH_INFO: `/v3/projects/4ff91046396d4393bd776405df6bc8c8` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:57.235858 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff91046396d4393bd776405df6bc8c8)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:57.237965 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:57.262233 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:57.285903 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff91046396d4393bd776405df6bc8c8', 'request_id': 'req-e02cb714-4466-430c-a068-4960933b789d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.294095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff91046396d4393bd776405df6bc8c8', 'request_id': 'req-e02cb714-4466-430c-a068-4960933b789d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.299728 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff91046396d4393bd776405df6bc8c8', 'request_id': 'req-e02cb714-4466-430c-a068-4960933b789d'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.310696 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] The token cache is being invalidate because project 4ff91046396d4393bd776405df6bc8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:57.310979 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.311598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.313059 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1439/2910] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:57 2022] DELETE /identity/v3/projects/4ff91046396d4393bd776405df6bc8c8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:57.317054 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:57.326990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d41ff-d8d0-4d57-97ac-c1907012bd08 service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:57.380759 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:57.381931 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:57.382208 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:57.382476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] PATH_INFO: `/v3/users/7bfcae4ffe5a4b0b813bab618b716f2b` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:57.383579 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bfcae4ffe5a4b0b813bab618b716f2b)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:57.385540 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:57.429702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bfcae4ffe5a4b0b813bab618b716f2b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.430702 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:57.444215 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bfcae4ffe5a4b0b813bab618b716f2b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.444874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bfcae4ffe5a4b0b813bab618b716f2b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.452025 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bfcae4ffe5a4b0b813bab618b716f2b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.452662 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ab6ac07d-5f13-45ce-a7c8-1715e88de0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bfcae4ffe5a4b0b813bab618b716f2b'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.464923 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1472/2911] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:21:57 2022] DELETE /identity/v3/users/7bfcae4ffe5a4b0b813bab618b716f2b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:57.732380 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:57.733835 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:57.750431 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cb714-4466-430c-a068-4960933b789d admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:57.809241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:57.809894 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:57.810177 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:57.810451 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] PATH_INFO: `/v3/projects/435c5eaa0db54b7281685f37dc704188` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:57.811610 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=435c5eaa0db54b7281685f37dc704188)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:57.813556 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:57.860311 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435c5eaa0db54b7281685f37dc704188', 'request_id': 'req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.867822 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435c5eaa0db54b7281685f37dc704188', 'request_id': 'req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.873155 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435c5eaa0db54b7281685f37dc704188', 'request_id': 'req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.884447 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] The token cache is being invalidate because project 435c5eaa0db54b7281685f37dc704188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:21:57.884736 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.885394 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-cdd4bddf-7a2f-4f12-9670-4c55020aa6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:21:57.886874 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1440/2912] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:21:57 2022] DELETE /identity/v3/projects/435c5eaa0db54b7281685f37dc704188 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:57.891930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:57.892409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:57.892516 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:57.912509 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:57.913744 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:57.970752 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1473/2913] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:57.978465 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:57.978750 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:57.979025 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:57.998609 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:57.999796 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:58.008101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1441/2914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:21:58.012204 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.022400 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121dee-9f29-47ee-95b2-a0b1ac39f309 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.027033 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.027629 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.027911 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.028182 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.028820 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:21:58.029120 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.030750 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.041962 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1474/2915] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:21:58.046104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.055113 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebeda7-86eb-4a5f-95bf-e05d79b6e2cc None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.059572 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.060150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.060428 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.060692 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.061353 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.063225 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.092619 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1442/2916] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:21:58 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 14:21:58.094247 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.104006 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb6859-fe09-4170-bfd2-50d519268a88 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.159452 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.160059 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.160345 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.160623 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.161291 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.163269 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.184765 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1475/2917] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:21:58 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:21:58.188837 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.199721 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324ba9-59d7-4741-b04d-9d0e8546d432 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.204260 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.204852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.205136 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.205445 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.206110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.207695 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.218009 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1443/2918] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:58.222108 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.231874 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaed6f-4e04-4289-acd4-5a67c35f736d admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.236427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.237012 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.237328 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.237605 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.238511 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.240091 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d43f5-ce77-493d-a8bd-6790afd7d37b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.250910 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1476/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:21:58.255018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.260843 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:58.267292 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19fe0-f311-4310-aef6-2c59aabd230c admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.272861 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.273542 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.273826 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.274101 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] PATH_INFO: `/v3/projects/5003f4734ce545a7a10a006651df0eb3/users/c0618ec036924210b120eed957ea08a7/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.288435 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5003f4734ce545a7a10a006651df0eb3, user_id=c0618ec036924210b120eed957ea08a7, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.291110 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.304018 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1444/2920] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:21:58 2022] PUT /identity/v3/projects/5003f4734ce545a7a10a006651df0eb3/users/c0618ec036924210b120eed957ea08a7/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:21:58.315209 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.315503 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.315780 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.343000 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] MFA Rules not processed for user `c0618ec036924210b120eed957ea08a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:21:58.344198 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:58.361756 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:21:58.408308 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1477/2921] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:21:58.419416 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:21:58.421095 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:21:58.479319 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c4dda-a510-47f2-bf06-20632736e4ed admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:21:58.482999 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:21:58.483537 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:21:58.483819 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:21:58.484092 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:21:58.492912 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:21:58.494413 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10d772-9563-4078-899b-c81dd54e2cea service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:21:58.503020 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1445/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:21:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:22:08.405551 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=18 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:08.499039 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:28.251710 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:28.312384 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535f6b-2e94-4731-97df-6ed8a8d6768d None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:28.316824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:28.317489 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:28.317774 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:28.318047 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] PATH_INFO: `/v3/users/c0618ec036924210b120eed957ea08a7` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:28.319157 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0618ec036924210b120eed957ea08a7)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:28.321086 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:28.366633 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0618ec036924210b120eed957ea08a7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.378571 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0618ec036924210b120eed957ea08a7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.379227 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0618ec036924210b120eed957ea08a7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.387197 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0618ec036924210b120eed957ea08a7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.387830 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0618ec036924210b120eed957ea08a7'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.399917 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1478/2923] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:22:28 2022] DELETE /identity/v3/users/c0618ec036924210b120eed957ea08a7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:22:28.404506 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:28.404959 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:28.405104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:28.423947 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:22:28.425165 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:28.483829 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1446/2924] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:22:28.493832 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:28.495272 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:28.551853 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006208-699b-4e43-932d-685b74c1027b admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:28.556600 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:28.557206 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:28.557547 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:28.557824 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:28.566718 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:28.568147 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5104c5-c4b5-4cad-8d5b-4db4ec247663 service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:28.577891 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1479/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:22:28.841671 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:28.843084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:28.855180 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe057a-2266-4c19-98c4-45eff6feeea5 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:28.860241 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:28.860871 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:28.861154 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:28.861467 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] PATH_INFO: `/v3/projects/5003f4734ce545a7a10a006651df0eb3` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:28.862643 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5003f4734ce545a7a10a006651df0eb3)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:28.864820 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:28.919255 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5003f4734ce545a7a10a006651df0eb3', 'request_id': 'req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.926362 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5003f4734ce545a7a10a006651df0eb3', 'request_id': 'req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.932087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5003f4734ce545a7a10a006651df0eb3', 'request_id': 'req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.942972 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] The token cache is being invalidate because project 5003f4734ce545a7a10a006651df0eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:22:28.943262 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.943884 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-0c72ffc8-ef56-46c1-a99c-8df5e4b1ed71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:28.945412 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1447/2926] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:22:28 2022] DELETE /identity/v3/projects/5003f4734ce545a7a10a006651df0eb3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:22:28.950287 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:28.950575 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:28.950850 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:28.970572 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:22:28.971773 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:28.988666 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:29.032162 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1480/2927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:22:29.040090 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.040377 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.040653 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.061404 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:22:29.062600 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:29.070365 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1448/2928] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:22:29.074344 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.083800 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815bcab-d2c5-44b1-a108-df521e678157 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.088383 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.089529 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.089815 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.090094 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.090743 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 14:22:29.091049 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.092687 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.104011 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1481/2929] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 14:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 14:22:29.108701 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.118046 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc553d-3bf0-4e54-9994-bf8a0e4f48d4 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.123150 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.123732 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.124012 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.124286 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.124908 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.126828 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.153272 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1449/2930] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 14:22:29 2022] POST /identity/v3/projects => generated 397 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:22:29.157276 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.167002 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f958ec-7bc7-4f9f-8e9b-5be33ba2b966 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.222248 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.222792 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.223076 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.223363 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] PATH_INFO: `/v3/users` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.223991 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.225980 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.251081 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1482/2931] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 14:22:29 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 14:22:29.255014 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.265758 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1be254-9fe6-40fb-a283-ebcc54f02116 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.270492 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.271074 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.271350 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.271621 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.272257 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.273869 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.283946 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1450/2932] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:22:29.287701 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.297969 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e480-897d-460f-b319-e1e10bc0de98 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.302563 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.303148 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.303427 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.303700 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.304332 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.305988 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6d8ac-ac31-491e-9ece-9ff816fa8bba admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.317142 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1483/2933] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 14:22:29.321296 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.331356 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111d415-6adb-4a3f-b523-d1f9c0e12dee admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.335930 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.336568 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.336852 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.337131 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] PATH_INFO: `/v3/projects/03a49a500abf43269be5ee0ac1d7e04b/users/9060c322a62c4819af7fa1d820427d25/roles/931034f8100747f0bd80ac5bdb966b9a` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.351391 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a49a500abf43269be5ee0ac1d7e04b, user_id=9060c322a62c4819af7fa1d820427d25, role_id=931034f8100747f0bd80ac5bdb966b9a)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.354078 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.368223 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1451/2934] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 14:22:29 2022] PUT /identity/v3/projects/03a49a500abf43269be5ee0ac1d7e04b/users/9060c322a62c4819af7fa1d820427d25/roles/931034f8100747f0bd80ac5bdb966b9a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:22:29.380158 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] REQUEST_METHOD: `POST` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.380447 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.380721 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.407671 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.auth.core [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] MFA Rules not processed for user `9060c322a62c4819af7fa1d820427d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:22:29.408862 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:29.470846 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1484/2935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 14:22:29.482475 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:29.484270 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:29.507359 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:29.543662 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d563bf2-7823-4d6c-99d2-e0959d6a53e0 admin admin] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:29.547482 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ef931ea9f54d2b85df3bb3f6158b81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:29.548084 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] REQUEST_METHOD: `GET` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:29.548369 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:29.548648 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:29.556984 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:29.559087 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe307a9-479a-491b-bbf6-35af44a27d99 service cinder] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:29.568017 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1452/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:22:34.541017 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:34.559273 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:34.604990 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c318f2e-2fb7-4604-92d9-767064b9b2a0 None None] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:34.611289 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:34.611930 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:34.612210 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:34.612483 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] PATH_INFO: `/v3/users/9060c322a62c4819af7fa1d820427d25` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:34.613664 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9060c322a62c4819af7fa1d820427d25)` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:34.615927 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:34.663039 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9060c322a62c4819af7fa1d820427d25'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:34.675160 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9060c322a62c4819af7fa1d820427d25'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:34.675825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9060c322a62c4819af7fa1d820427d25'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:34.682805 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9060c322a62c4819af7fa1d820427d25'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:34.683425 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.notifications [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9060c322a62c4819af7fa1d820427d25'} {{(pid=81613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:34.695901 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1485/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 14:22:34 2022] DELETE /identity/v3/users/9060c322a62c4819af7fa1d820427d25 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 14:22:34.700922 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] REQUEST_METHOD: `POST` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:34.701444 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:34.701550 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:34.720508 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.auth.core [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] MFA Rules not processed for user `1ee0b2255cbf41fe9a777949eff22087`. Rule list: `[]` (Enabled: `True`). {{(pid=81612) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 14:22:34.721741 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:34.780715 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1453/2938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 14:22:34.790507 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:34.791926 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:34.848576 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9af74-3f9e-4702-9080-60b910f054d6 admin admin] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:34.852137 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c4e0b235524e84b0d003e7dfdb00fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:34.852735 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:34.853022 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:34.853329 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:34.862802 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:34.864505 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:34.874303 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1486/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:22:35.136785 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] Authenticating user token {{(pid=81612) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:22:35.138245 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.fernet_utils [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81612) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:22:35.151511 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66bc3e-66ef-4dd6-a821-b07b354ffc06 None None] Validating token access rules against request {{(pid=81612) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:22:35.156659 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ee0b2255cbf41fe9a777949eff22087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '385992f3807a48ff8e105d88b2b7542e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81612) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:22:35.157318 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:22:35.157598 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:22:35.157868 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] PATH_INFO: `/v3/projects/03a49a500abf43269be5ee0ac1d7e04b` {{(pid=81612) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:22:35.158976 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a49a500abf43269be5ee0ac1d7e04b)` {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:22:35.160888 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] RBAC: Authorization granted {{(pid=81612) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:22:35.207833 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a49a500abf43269be5ee0ac1d7e04b', 'request_id': 'req-7159bdac-74b0-478d-a630-323e94734981'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:35.216127 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a49a500abf43269be5ee0ac1d7e04b', 'request_id': 'req-7159bdac-74b0-478d-a630-323e94734981'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:35.222027 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a49a500abf43269be5ee0ac1d7e04b', 'request_id': 'req-7159bdac-74b0-478d-a630-323e94734981'} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:35.233636 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] The token cache is being invalidate because project 03a49a500abf43269be5ee0ac1d7e04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81612) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 14:22:35.233925 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:35.234579 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG keystone.notifications [None req-7159bdac-74b0-478d-a630-323e94734981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81612) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 14:22:35.236068 dv-cinder-835878-4-smb devstack@keystone.service[81612]: [pid: 81612|app: 0|req: 1454/2940] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 14:22:35 2022] DELETE /identity/v3/projects/03a49a500abf43269be5ee0ac1d7e04b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 14:22:44.869841 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:22:45.230104 dv-cinder-835878-4-smb devstack@keystone.service[81612]: DEBUG dbcounter [-] [81612] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 14:25:36.164897 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] Authenticating user token {{(pid=81613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 14:25:36.166380 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:25:36.235409 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a96b-d17e-44f0-ad34-81b3660a9dcc service neutron] Validating token access rules against request {{(pid=81613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 14:25:36.293961 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1370e4280744ad6b76881a9e0fafbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48a0eb4677d64941af58cc1ebf006dda', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 14:25:36.294675 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] REQUEST_METHOD: `GET` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 14:25:36.294963 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] SCRIPT_NAME: `/identity` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 14:25:36.295237 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 14:25:36.297584 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.fernet_utils [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 14:25:36.308476 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 14:25:36.310098 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598096-32ee-4c7a-80bb-aea21cfcf95b service placement] RBAC: Authorization granted {{(pid=81613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 14:25:36.319825 dv-cinder-835878-4-smb devstack@keystone.service[81613]: [pid: 81613|app: 0|req: 1487/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 14:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 14:25:46.315621 dv-cinder-835878-4-smb devstack@keystone.service[81613]: DEBUG dbcounter [-] [81613] Writing DB stats keystone:SELECT=58 {{(pid=81613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}